Jul 07 16:16:35.830031 ip-10-0-135-243 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 16:16:35.830043 ip-10-0-135-243 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 16:16:35.830049 ip-10-0-135-243 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 16:16:35.830309 ip-10-0-135-243 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 16:16:45.966095 ip-10-0-135-243 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 16:16:45.966112 ip-10-0-135-243 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3806fbdb14fe478aac8fb30eae66a9bf --
Jul 07 16:18:20.019212 ip-10-0-135-243 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 16:18:20.469620 ip-10-0-135-243 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:18:20.469620 ip-10-0-135-243 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 16:18:20.469620 ip-10-0-135-243 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:18:20.469620 ip-10-0-135-243 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 16:18:20.469620 ip-10-0-135-243 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:18:20.469620 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.466624    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470968    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470978    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470982    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470985    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470988    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470991    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470995    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.470998    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471001    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471004    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471006    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471009    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471011    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471014    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471017    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471019    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471021    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471024    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471026    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:20.538793 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471029    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471031    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471034    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471037    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471040    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471043    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471046    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471049    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471051    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471054    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471056    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471059    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471061    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471064    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471067    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471069    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471072    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471075    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471079    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:20.549707 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471091    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471094    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471097    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471100    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471102    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471105    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471107    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471110    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471112    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471117    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471121    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471124    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471126    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471129    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471131    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471134    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471136    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471139    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471142    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471145    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:20.551862 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471147    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:20.552070 ip-10-0-135-243 systemd[1]: Started Kubernetes Kubelet.
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471150    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471152    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471154    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471157    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471159    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471162    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471165    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471168    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471170    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471173    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471176    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471178    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471186    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471189    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471192    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471194    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471197    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471199    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471203    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:20.556842 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471205    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471207    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471210    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471212    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471215    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471217    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471219    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471222    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471224    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471227    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471229    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471232    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471235    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471237    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471240    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471243    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471246    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471250    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471253    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:20.782074 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471256    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.471259    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472038    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472046    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472050    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472054    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472058    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472062    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472065    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472068    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472071    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472073    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472076    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472079    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472082    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472085    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472088    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472090    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472093    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472095    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:20.783496 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472098    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472102    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472105    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472109    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472111    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472116    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472118    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472122    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472125    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472128    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472131    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472133    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472136    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472139    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472141    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472144    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472148    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472151    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472153    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:20.784866 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472156    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472159    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472162    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472164    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472166    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472169    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472172    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472174    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472177    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472180    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472183    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472185    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472188    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472191    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472193    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472195    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472198    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472200    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472203    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472205    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:20.787922 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472208    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472211    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472214    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472216    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472219    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472221    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472224    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472227    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472229    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472235    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472238    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472240    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472243    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472245    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472249    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472251    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472254    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472256    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472259    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472261    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:20.789084 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472264    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472266    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472269    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472271    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472274    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472276    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472280    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472282    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472285    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472287    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472290    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472292    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472295    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472297    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472300    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472302    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472305    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472307    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472309    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472312    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:20.790383 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472315    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472319    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472724    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472729    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472732    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472736    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472740    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472743    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472746    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472748    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472751    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472754    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472757    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472760    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472762    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472765    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472767    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472770    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472773    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472775    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:20.792580 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472778    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472781    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472785    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472788    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472790    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472794    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472798    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472801    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472804    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472807    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472809    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472812    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472815    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472819    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472821    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472824    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472827    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472830    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472834    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:20.793710 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472837    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472840    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472843    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472846    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472848    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472851    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472853    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472856    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472859    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472861    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472864    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472867    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472869    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472872    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472874    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472878    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472881    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472884    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472886    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:20.795237 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472889    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472891    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472894    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472897    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472899    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472901    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472904    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472907    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472910    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472913    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472915    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472918    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472920    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472923    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472926    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472929    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472931    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472933    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472936    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472939    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:20.796108 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472942    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472944    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472966    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472969    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472971    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472974    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472976    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472979    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472983    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472985    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472988    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472991    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472993    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472996    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.472998    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473001    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473003    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473006    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473008    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:20.797659 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473014    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473017    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473020    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473023    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473091    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473097    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473104    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473108    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473112    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473115    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473119    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473123    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473126    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473129    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473132    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473135    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473138    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473141    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473144    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473147    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473150    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473155    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473176    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473179    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 16:18:20.798772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473182    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473186    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473189    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473193    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473196    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473199    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473202    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473205    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473209    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473212    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473215    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473218    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473222    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473225    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473228    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473231    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473234    2573 flags.go:64] FLAG: --enable-server="true"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473237    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473242    2573 flags.go:64] FLAG: --event-burst="100"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473245    2573 flags.go:64] FLAG: --event-qps="50"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473248    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473251    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473253    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473257    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 16:18:20.799849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473260    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473263    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473266    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473269    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473272    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473276    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473279    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473282    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473285    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473287    2573 flags.go:64] FLAG: --feature-gates=""
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473291    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473294    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473297    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473300    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473303    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473306    2573 flags.go:64] FLAG: --help="false"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473310    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473314    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473317    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473320    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473323    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473327    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473330    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 16:18:20.800909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473332    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473335    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473338    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473341    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473344    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473347    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473350    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473352    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473355    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473358    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473361    2573 flags.go:64] FLAG: --lock-file=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473363    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473366    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473369    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473376    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473378    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473381    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473384    2573 flags.go:64] FLAG: --logging-format="text"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473387    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473390    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473393    2573 flags.go:64] FLAG: --manifest-url=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473396    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473400    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473402    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473406    2573 flags.go:64] FLAG: --max-pods="110"
Jul 07 16:18:20.802222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473411    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473414    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473417    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473420    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473423    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473425    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473428    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473435    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473438    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473441    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473443    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473447    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473452    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473455    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473458    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473461    2573 flags.go:64] FLAG: --port="10250"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473464    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473467    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cf0b1b5c5bf3037f"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473470    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473473    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473476    2573 flags.go:64] FLAG: --register-node="true"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473478    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473483    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473486    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 07 16:18:20.803316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473489    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473492    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473495    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473499    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473502    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473504    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473507    2573 flags.go:64] FLAG: --runonce="false"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473510    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473515    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473517    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473520    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473523    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473526    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473529    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473532    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473534    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473537    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473540    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473543    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473546    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473549    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473552    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473557    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473560    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473562    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 16:18:20.804418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473566    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473569    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473572    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473574    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473577    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473581    2573 flags.go:64] FLAG: --v="2"
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473585    2573 flags.go:64] FLAG: --version="false"
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473589    2573 flags.go:64] FLAG: --vmodule=""
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473593    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.473596    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473711    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473715    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473719    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473722    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473725    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473728    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473731    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473734    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473736    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473739    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473741    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473744    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:20.808696 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473746    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473749    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473751    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473754    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473756    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473759    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473762    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473764    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473767    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473769    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473772    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473774    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473777    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473779    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473781    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473786    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473789    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473791    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473794    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473796    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:20.809537 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473799    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473803    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473806    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473809    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473812    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473816    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473819    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473823    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473826    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473829    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473832    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473834    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473837    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473840    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473842    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473845    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473848    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473851    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:20.810376 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473853    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473856    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473858    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473862    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473865    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473868    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473871    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473874    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473876    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473880    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473883    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473886    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473888    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473891    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473893    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473896    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473898    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473901    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473903    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:20.811233 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473908    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473910    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473913    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473915    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473917    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473920    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473922    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473925    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473927    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473930    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473932    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473935    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473937    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473940    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473943    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473961    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473965    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473968    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473971    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473973    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:20.811859 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473976    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473978    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473982    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473985    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473987    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473990    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473992    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473995    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.473997    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.474000    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.474708    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.482891    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.482908    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.483771    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.483779    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 16:18:20.813142 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483842    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483847    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483851    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483854    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483858    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483860    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483865    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483869    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483872    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483875    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483878    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483881    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483884    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483887    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483890    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483892    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483895    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483899    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483903    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483906    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:20.813765 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483911    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483913    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483916    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483918    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483921    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483924    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483926    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483929    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483932    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483935    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483937    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483940    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483943    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483958    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483961    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483964    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483967    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483970    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483973    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483976    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:20.815879 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483979    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483981    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483984    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483986    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483989    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483991    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483994    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483997    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.483999    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484002    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484004    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484007    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484012    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484015    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484018    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484020    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484023    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484025    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484028    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484030    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:20.816729 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484033    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484035    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484039    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484041    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484044    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484047    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484049    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484052    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484054    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484057    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484059    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484062    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484064    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484067    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484070    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484072    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484075    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484077    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484080    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:20.817788 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484082    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484085    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484088    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484090    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484092    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484097    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484099    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484102    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484104    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484107    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484111    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484115    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484118    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484121    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484124    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484126    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484130    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484133    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484135    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:20.818414 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484144    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.484149    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484295    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484301    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484305    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484308    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484310    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484313    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484316    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484319    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484321    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484324    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484327    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484329    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484332    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:20.819072 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484334    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484336    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484339    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484341    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484346    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484348    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484351    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484353    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484356    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484358    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484361    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484363    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484366    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484368    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484371    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484381    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484384    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484387    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484390    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:20.819713 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484393    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484396    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484400    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484403    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484406    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484409    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484411    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484414    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484416    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484419    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484421    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484424    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484426    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484429    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484431    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484434    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484436    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484439    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484442    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484445    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:20.820352 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484447    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484449    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484452    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484454    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484457    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484459    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484462    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484464    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484467    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484475    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484478    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484480    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484483    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484485    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484489    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484491    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484494    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484496    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484499    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484502    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:20.821923 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484504    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484507    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484509    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484513    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484516    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484519    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484522    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484525    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484527    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484531    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484533    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484536    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484539    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484541    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484544    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484546    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484549    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484551    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484554    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:20.822783 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484556    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484558    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484561    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484569    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484572    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484574    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484577    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:20.484581    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.484586    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.484717    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.487124    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.488915    2573 server.go:1019] "Starting client certificate rotation"
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.489014    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.489849    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:18:20.823419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.491859    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.497385    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.509493    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.512026    2573 log.go:25] "Validated CRI v1 image API"
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.512769    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.519026    2573 fs.go:135] Filesystem UUIDs: map[08aa44af-e6e2-4313-a52f-9f5e6aa600ac:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b8b2f4a9-0f10-4eab-a36f-7893d9eb5010:/dev/nvme0n1p4]
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.519040    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 16:18:20.824255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.521439    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.523614    2573 manager.go:216] Machine: {Timestamp:2026-07-07 16:18:20.523150109 +0000 UTC m=+0.374764273 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099620 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20424c374670749ac91564a005e82b SystemUUID:ec20424c-3746-7074-9ac9-1564a005e82b BootID:3806fbdb-14fe-478a-ac8f-b30eae66a9bf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:4b:cd:4a:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:4b:cd:4a:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:cb:f0:d0:b1:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.523713    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.523804    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.527602    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.527634    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.528473    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.528484    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.528491    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.529328    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.531234    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.535865    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536000    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536033    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536049    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536068    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536086    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536097    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 16:18:20.825737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536467    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.536496    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.539041    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.542378    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.542405    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543785    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543810    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543838    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543851    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543868    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543880    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543897    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543908    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543920    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543931    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543966    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.543978    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.545803    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.545812    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.549819    2573 server.go:1268] "Started kubelet"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.550080    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.550327    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.550406    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.550390    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.550478    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.552172    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hkzzc"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.552677    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.553774    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.554032    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.556626    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.559021    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hkzzc"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.560524    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-243.ec2.internal.18c00e3b5c17528d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-243.ec2.internal,UID:ip-10-0-135-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-243.ec2.internal,},FirstTimestamp:2026-07-07 16:18:20.549608077 +0000 UTC m=+0.401222444,LastTimestamp:2026-07-07 16:18:20.549608077 +0000 UTC m=+0.401222444,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-243.ec2.internal,}"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.566367    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.566385    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.566440    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567179    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567183    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567207    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567339    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567350    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 16:18:20.892925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567936    2573 factory.go:55] Registering systemd factory
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.567968    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.568153    2573 factory.go:153] Registering CRI-O factory
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.568165    2573 factory.go:223] Registration of the crio container factory successfully
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.568213    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.568230    2573 factory.go:103] Registering Raw factory
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.568243    2573 manager.go:1196] Started watching for new ooms in manager
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.568631    2573 manager.go:349] Starting recovery of all containers
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.570461    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.574444    2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-243.ec2.internal\" not found" node="ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.579476    2573 manager.go:354] Recovery completed
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.583810    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585462    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585488    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585499    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585927    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585935    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585939    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.585966    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.586647    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.586667    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.586675    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.588148    2573 policy_none.go:49] "None policy: Start"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.588162    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.588172    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.590704    2573 policy_none.go:47] "Start"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.639542    2573 manager.go:337] "Starting Device Plugin manager"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.639569    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.639578    2573 server.go:87] "Starting device plugin registration server"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.639827    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.639839    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.639994    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.640066    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.640074    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.640461    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.640508    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.651294    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.652465    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.652500    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.652518    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.652547    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.654769    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.740102    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.740964    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.740991    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.741001    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.741025    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.749826    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.894575 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.749844    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-243.ec2.internal\": node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.753141    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"]
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.753193    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.753914    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.753936    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.753965    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.756144    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.756248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.756280    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.757051    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.757074    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.757085    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.757138    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.757160    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.757174    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.758298    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.759111    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.759130    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.760334    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.760354    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.760364    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.777525    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-243.ec2.internal\" not found" node="ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.781584    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-243.ec2.internal\" not found" node="ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.858595    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:20.896942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.892423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ed45cc5e111bc2d8ba09694a5ee017d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal\" (UID: \"7ed45cc5e111bc2d8ba09694a5ee017d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:20.964912 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:20.958644    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.030930 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:20.892446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ed45cc5e111bc2d8ba09694a5ee017d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal\" (UID: \"7ed45cc5e111bc2d8ba09694a5ee017d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.030930 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.004435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dde6cf80b51827f1dbc1de58a509a849-config\") pod \"kube-apiserver-proxy-ip-10-0-135-243.ec2.internal\" (UID: \"dde6cf80b51827f1dbc1de58a509a849\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.100882 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.059244    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.105170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.104681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ed45cc5e111bc2d8ba09694a5ee017d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal\" (UID: \"7ed45cc5e111bc2d8ba09694a5ee017d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.105170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.104708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ed45cc5e111bc2d8ba09694a5ee017d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal\" (UID: \"7ed45cc5e111bc2d8ba09694a5ee017d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.105170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.104729    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dde6cf80b51827f1dbc1de58a509a849-config\") pod \"kube-apiserver-proxy-ip-10-0-135-243.ec2.internal\" (UID: \"dde6cf80b51827f1dbc1de58a509a849\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.105170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.104787    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ed45cc5e111bc2d8ba09694a5ee017d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal\" (UID: \"7ed45cc5e111bc2d8ba09694a5ee017d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.105170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.104801    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ed45cc5e111bc2d8ba09694a5ee017d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal\" (UID: \"7ed45cc5e111bc2d8ba09694a5ee017d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.105170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.104838    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dde6cf80b51827f1dbc1de58a509a849-config\") pod \"kube-apiserver-proxy-ip-10-0-135-243.ec2.internal\" (UID: \"dde6cf80b51827f1dbc1de58a509a849\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.179020 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.129813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.179020 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.159984    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.320770 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.260628    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.367653 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.361121    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.382433 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.382417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:21.462095 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.462074    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.488397 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.488381    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 16:18:21.488799 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.488496    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:18:21.488799 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.488510    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:18:21.562179 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.562159    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.565415 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.565389    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:13:20 +0000 UTC" deadline="2028-03-31 12:35:21.529661084 +0000 UTC"
Jul 07 16:18:21.565415 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.565414    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15188h16m59.964249553s"
Jul 07 16:18:21.663272 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.663250    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.764076 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.764032    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.838045 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:21.838006    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed45cc5e111bc2d8ba09694a5ee017d.slice/crio-66f6f41a38fa309eec8a381df844418b310defe0cb1c9273d70607abce59883e WatchSource:0}: Error finding container 66f6f41a38fa309eec8a381df844418b310defe0cb1c9273d70607abce59883e: Status 404 returned error can't find the container with id 66f6f41a38fa309eec8a381df844418b310defe0cb1c9273d70607abce59883e
Jul 07 16:18:21.838607 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:21.838591    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde6cf80b51827f1dbc1de58a509a849.slice/crio-62bc0a87d76842c38d2d19d43148158e3a4218013b648815c14cc54a5501d91d WatchSource:0}: Error finding container 62bc0a87d76842c38d2d19d43148158e3a4218013b648815c14cc54a5501d91d: Status 404 returned error can't find the container with id 62bc0a87d76842c38d2d19d43148158e3a4218013b648815c14cc54a5501d91d
Jul 07 16:18:21.843311 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:21.843292    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:18:21.864840 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.864815    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:21.969173 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:21.969110    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:22.041626 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.041603    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:22.069926 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.069903    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-243.ec2.internal\" not found"
Jul 07 16:18:22.104900 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.104882    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:22.171018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.170994    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:22.183453 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.183432    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:18:22.184580 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.184568    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal"
Jul 07 16:18:22.193704 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.193686    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:18:22.337875 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.337812    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:22.537728 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.537695    2573 apiserver.go:52] "Watching apiserver"
Jul 07 16:18:22.545641 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.545502    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 16:18:22.546755 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.546726    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-khnvq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal","openshift-multus/multus-additional-cni-plugins-fr9dd","openshift-dns/node-resolver-cbw7m","openshift-multus/multus-76wvn","openshift-multus/network-metrics-daemon-6gt2n","openshift-network-diagnostics/network-check-target-rk99f","openshift-network-operator/iptables-alerter-8bw94","openshift-ovn-kubernetes/ovnkube-node-9tm8f","kube-system/global-pull-secret-syncer-xkn26","kube-system/konnectivity-agent-zxdfg","kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7","openshift-cluster-node-tuning-operator/tuned-9xxl8"]
Jul 07 16:18:22.549654 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.549450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:22.549654 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.549553    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:22.551928 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.551901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.555015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.554157    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.555015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.554588    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g5h8q\""
Jul 07 16:18:22.555015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.554799    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 16:18:22.555015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.554978    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.555268 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.555179    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.556952 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.556929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.557509 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.557485    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 16:18:22.557811 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.557790    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.557899 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.557875    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 16:18:22.558088 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.558068    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.558289 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.558264    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-87226\""
Jul 07 16:18:22.559139 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.559098    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.559267 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.559245    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 16:18:22.559378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.559272    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.559439 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.559408    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w5dpt\""
Jul 07 16:18:22.559544 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.559502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.562017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.561994    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 16:18:22.562017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.562011    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zsrvb\""
Jul 07 16:18:22.562017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.562018    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:22.562247 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.562082    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:22.564416 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.564394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.566635 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.566614    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 16:18:22.566734 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.566680    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 16:18:22.567627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567013    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 16:18:22.567627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567068    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.567627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567096    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x7mpw\""
Jul 07 16:18:22.567627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.567627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567424    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.567627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567447    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 16:18:22.567961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.567778    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 16:18:22.569635 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.569617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.570786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.570274    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.570786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.570326    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 16:18:22.570786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.570526    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.570786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.570688    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bt5c7\""
Jul 07 16:18:22.572080 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.572058    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.572435 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.572272    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2xvc\""
Jul 07 16:18:22.572435 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.572285    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.572706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.572689    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.572792 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.572766    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:22.575881 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.575663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.577998 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.577955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 16:18:22.578155 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.578132    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 16:18:22.578250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.578218    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zc949\""
Jul 07 16:18:22.578456 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.578344    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.579451 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.579132    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:18:22.582062 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.581765    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 16:18:22.582062 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.581803    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r76vg\""
Jul 07 16:18:22.582062 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.582010    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 16:18:22.583596 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.582345    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:18:22.607457 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.607169    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bhczv"
Jul 07 16:18:22.616818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.616801    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bhczv"
Jul 07 16:18:22.620305 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-registration-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.620417 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620321    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-etc-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.620417 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5qpk\" (UniqueName: \"kubernetes.io/projected/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-kube-api-access-p5qpk\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.620528 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620424    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-systemd\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.620528 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpvbl\" (UniqueName: \"kubernetes.io/projected/53257505-275e-41f3-ab08-924aee1fc3fd-kube-api-access-lpvbl\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.620528 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-cni-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.620684 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysctl-d\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.620684 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-run\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.620684 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-cni-bin\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.620684 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-ovn\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.620869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-device-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.620869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqgxv\" (UniqueName: \"kubernetes.io/projected/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-kube-api-access-vqgxv\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:22.620869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.620869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620774    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovnkube-script-lib\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.620869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620819    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d41daa32-170a-4b6b-8597-9fcc3e840e25-host\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.620869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-kubernetes\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-sys\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-lib-modules\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovn-node-metrics-cert\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-cni-binary-copy\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.620994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-os-release\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnj7g\" (UniqueName: \"kubernetes.io/projected/18dad78b-587d-46cf-a754-d8c3785b4767-kube-api-access-bnj7g\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53257505-275e-41f3-ab08-924aee1fc3fd-etc-tuned\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-hosts-file\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.621140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-modprobe-d\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysctl-conf\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-cnibin\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-socket-dir-parent\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsfv6\" (UniqueName: \"kubernetes.io/projected/d41daa32-170a-4b6b-8597-9fcc3e840e25-kube-api-access-wsfv6\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-cnibin\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621300    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-cni-bin\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-socket-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-sys-fs\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-system-cni-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-etc-kubernetes\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxfzq\" (UniqueName: \"kubernetes.io/projected/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-kube-api-access-hxfzq\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovnkube-config\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.621510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53257505-275e-41f3-ab08-924aee1fc3fd-tmp\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-os-release\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-daemon-config\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-cni-netd\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-cni-binary-copy\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-netns\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-cni-multus\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-var-lib-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhmt\" (UniqueName: \"kubernetes.io/projected/c50a5804-912f-431f-87e2-8b1f5fddafa8-kube-api-access-blhmt\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d41daa32-170a-4b6b-8597-9fcc3e840e25-serviceca\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-env-overrides\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysconfig\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.621987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-var-lib-kubelet\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-host\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.622153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622037    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mh56\" (UniqueName: \"kubernetes.io/projected/0312b586-05bb-4a28-9a24-4a27797223dd-kube-api-access-5mh56\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-system-cni-dir\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-hostroot\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622110    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-systemd-units\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-k8s-cni-cncf-io\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622169    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-conf-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622193    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-multus-certs\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-slash\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-run-netns\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-systemd\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-kubelet\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622336    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-kubelet\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-node-log\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-log-socket\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-tmp-dir\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.622689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.623447 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.623447 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.622507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.658399 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.658342    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal" event={"ID":"dde6cf80b51827f1dbc1de58a509a849","Type":"ContainerStarted","Data":"62bc0a87d76842c38d2d19d43148158e3a4218013b648815c14cc54a5501d91d"}
Jul 07 16:18:22.659962 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.659914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal" event={"ID":"7ed45cc5e111bc2d8ba09694a5ee017d","Type":"ContainerStarted","Data":"66f6f41a38fa309eec8a381df844418b310defe0cb1c9273d70607abce59883e"}
Jul 07 16:18:22.668472 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.668449    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 16:18:22.722918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.722892    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7585c233-ad19-4b82-b85d-4474a2f3e31d-host-slash\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.723049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.722924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-cni-binary-copy\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.722942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-netns\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.722972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-cni-multus\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:22.723049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-cni-multus\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723104    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-netns\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723250 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.723152    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:22.723250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-var-lib-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.723250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhmt\" (UniqueName: \"kubernetes.io/projected/c50a5804-912f-431f-87e2-8b1f5fddafa8-kube-api-access-blhmt\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.723250 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.723214    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:23.223198163 +0000 UTC m=+3.074812315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:22.723250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d41daa32-170a-4b6b-8597-9fcc3e840e25-serviceca\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723253    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723272    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-env-overrides\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723287    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysconfig\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-var-lib-kubelet\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723322    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-host\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723375    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-host\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mh56\" (UniqueName: \"kubernetes.io/projected/0312b586-05bb-4a28-9a24-4a27797223dd-kube-api-access-5mh56\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723412    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysconfig\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.723501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723424    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-var-lib-kubelet\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723510    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-var-lib-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-system-cni-dir\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-hostroot\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723604    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-cni-binary-copy\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723613    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-systemd-units\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqm8g\" (UniqueName: \"kubernetes.io/projected/7585c233-ad19-4b82-b85d-4474a2f3e31d-kube-api-access-wqm8g\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-k8s-cni-cncf-io\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723679    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-system-cni-dir\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-conf-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723708    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-systemd-units\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723763    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-k8s-cni-cncf-io\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.723961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.723816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-conf-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.724582 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724003    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-env-overrides\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.724582 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724087    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d41daa32-170a-4b6b-8597-9fcc3e840e25-serviceca\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.724740 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724617    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-hostroot\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.724740 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-multus-certs\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.724840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-slash\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.724840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724768    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-run-netns\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.724840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724780    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-run-multus-certs\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.724840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724808    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-systemd\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.724840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724825    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-slash\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.724840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724839    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-run-netns\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724889    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-systemd\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.724897    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-kubelet\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-kubelet\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-node-log\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-log-socket\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-tmp-dir\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7585c233-ad19-4b82-b85d-4474a2f3e31d-iptables-alerter-script\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-registration-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-etc-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5qpk\" (UniqueName: \"kubernetes.io/projected/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-kube-api-access-p5qpk\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-systemd\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.725495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpvbl\" (UniqueName: \"kubernetes.io/projected/53257505-275e-41f3-ab08-924aee1fc3fd-kube-api-access-lpvbl\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-cni-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysctl-d\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-run\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-cni-bin\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-ovn\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/623fc414-12dd-4832-aa99-074449419721-dbus\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ebb3925-f327-4dfd-ae03-b977412f6bdb-agent-certs\") pod \"konnectivity-agent-zxdfg\" (UID: \"3ebb3925-f327-4dfd-ae03-b977412f6bdb\") " pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-device-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqgxv\" (UniqueName: \"kubernetes.io/projected/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-kube-api-access-vqgxv\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovnkube-script-lib\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d41daa32-170a-4b6b-8597-9fcc3e840e25-host\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-kubernetes\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.725947 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-sys\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.725991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-lib-modules\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovn-node-metrics-cert\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-cni-binary-copy\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-os-release\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnj7g\" (UniqueName: \"kubernetes.io/projected/18dad78b-587d-46cf-a754-d8c3785b4767-kube-api-access-bnj7g\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53257505-275e-41f3-ab08-924aee1fc3fd-etc-tuned\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-hosts-file\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-modprobe-d\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726296    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysctl-conf\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-cnibin\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-socket-dir-parent\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsfv6\" (UniqueName: \"kubernetes.io/projected/d41daa32-170a-4b6b-8597-9fcc3e840e25-kube-api-access-wsfv6\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-cnibin\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-cni-bin\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-socket-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.726667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-sys-fs\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-system-cni-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726642    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-etc-kubernetes\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxfzq\" (UniqueName: \"kubernetes.io/projected/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-kube-api-access-hxfzq\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovnkube-config\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53257505-275e-41f3-ab08-924aee1fc3fd-tmp\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-os-release\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-daemon-config\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-cni-netd\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/623fc414-12dd-4832-aa99-074449419721-kubelet-config\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.726900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ebb3925-f327-4dfd-ae03-b977412f6bdb-konnectivity-ca\") pod \"konnectivity-agent-zxdfg\" (UID: \"3ebb3925-f327-4dfd-ae03-b977412f6bdb\") " pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-kubelet\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727116    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-kubelet\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727163    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-node-log\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727211    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-log-socket\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727467    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-cni-bin\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.727473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727469    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-hosts-file\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727510    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-cnibin\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727591    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-socket-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727613    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-cnibin\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727636    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysctl-d\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727754    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-sys\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727763    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-tmp-dir\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727820    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727876    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-sys-fs\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727903    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-cni-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-socket-dir-parent\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727935    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-run-ovn\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.727977    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728051    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-etc-kubernetes\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.728229 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728125    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-system-cni-dir\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.728964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728360    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-device-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.728964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728439    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-os-release\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.728964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728587    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.728964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728640    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0312b586-05bb-4a28-9a24-4a27797223dd-registration-dir\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.728964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-etc-openvswitch\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.728964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.728741    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.729312 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729291    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-cni-netd\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.729449 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729370    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-systemd\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.729449 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729379    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.729580 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729521    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d41daa32-170a-4b6b-8597-9fcc3e840e25-host\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.729634 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729587    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-os-release\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.729634 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729593    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-run\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.729741 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729638    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-multus-daemon-config\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.729741 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729701    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-lib-modules\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.729853 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729821    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-modprobe-d\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.729917 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729862    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-kubernetes\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.729917 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.729894    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovnkube-script-lib\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.730119 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.730098    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53257505-275e-41f3-ab08-924aee1fc3fd-etc-sysctl-conf\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.730185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.730143    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18dad78b-587d-46cf-a754-d8c3785b4767-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.730244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.730193    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c50a5804-912f-431f-87e2-8b1f5fddafa8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.730320 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.730300    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-host-var-lib-cni-bin\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.730554 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.730512    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovnkube-config\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.730654 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.730632    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18dad78b-587d-46cf-a754-d8c3785b4767-cni-binary-copy\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.730792 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.730759    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:22.730792 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.730789    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:22.730953 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.730803    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:22.730953 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.730872    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:23.23085442 +0000 UTC m=+3.082468573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:22.732051 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.732011    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53257505-275e-41f3-ab08-924aee1fc3fd-etc-tuned\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.732124 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.732067    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53257505-275e-41f3-ab08-924aee1fc3fd-tmp\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.732124 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.732085    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c50a5804-912f-431f-87e2-8b1f5fddafa8-ovn-node-metrics-cert\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.732811 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.732788    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhmt\" (UniqueName: \"kubernetes.io/projected/c50a5804-912f-431f-87e2-8b1f5fddafa8-kube-api-access-blhmt\") pod \"ovnkube-node-9tm8f\" (UID: \"c50a5804-912f-431f-87e2-8b1f5fddafa8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.733198 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.733179    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mh56\" (UniqueName: \"kubernetes.io/projected/0312b586-05bb-4a28-9a24-4a27797223dd-kube-api-access-5mh56\") pod \"aws-ebs-csi-driver-node-pcwt7\" (UID: \"0312b586-05bb-4a28-9a24-4a27797223dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.743751 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.743729    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsfv6\" (UniqueName: \"kubernetes.io/projected/d41daa32-170a-4b6b-8597-9fcc3e840e25-kube-api-access-wsfv6\") pod \"node-ca-khnvq\" (UID: \"d41daa32-170a-4b6b-8597-9fcc3e840e25\") " pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.744234 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.744208    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxfzq\" (UniqueName: \"kubernetes.io/projected/5f935075-bc63-417d-bc19-e0b6ddd3b6e0-kube-api-access-hxfzq\") pod \"multus-76wvn\" (UID: \"5f935075-bc63-417d-bc19-e0b6ddd3b6e0\") " pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.744503 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.744485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5qpk\" (UniqueName: \"kubernetes.io/projected/ed0eb0c0-a23a-4d82-b558-8efa1860ff9a-kube-api-access-p5qpk\") pod \"node-resolver-cbw7m\" (UID: \"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a\") " pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.744669 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.744652    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnj7g\" (UniqueName: \"kubernetes.io/projected/18dad78b-587d-46cf-a754-d8c3785b4767-kube-api-access-bnj7g\") pod \"multus-additional-cni-plugins-fr9dd\" (UID: \"18dad78b-587d-46cf-a754-d8c3785b4767\") " pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.745243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.745223    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpvbl\" (UniqueName: \"kubernetes.io/projected/53257505-275e-41f3-ab08-924aee1fc3fd-kube-api-access-lpvbl\") pod \"tuned-9xxl8\" (UID: \"53257505-275e-41f3-ab08-924aee1fc3fd\") " pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.745294 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.745254    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqgxv\" (UniqueName: \"kubernetes.io/projected/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-kube-api-access-vqgxv\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:22.827266 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqm8g\" (UniqueName: \"kubernetes.io/projected/7585c233-ad19-4b82-b85d-4474a2f3e31d-kube-api-access-wqm8g\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.827405 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7585c233-ad19-4b82-b85d-4474a2f3e31d-iptables-alerter-script\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.827481 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827446    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.827540 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/623fc414-12dd-4832-aa99-074449419721-dbus\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.827540 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ebb3925-f327-4dfd-ae03-b977412f6bdb-agent-certs\") pod \"konnectivity-agent-zxdfg\" (UID: \"3ebb3925-f327-4dfd-ae03-b977412f6bdb\") " pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.827643 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.827558    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:22.827643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/623fc414-12dd-4832-aa99-074449419721-kubelet-config\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.827643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ebb3925-f327-4dfd-ae03-b977412f6bdb-konnectivity-ca\") pod \"konnectivity-agent-zxdfg\" (UID: \"3ebb3925-f327-4dfd-ae03-b977412f6bdb\") " pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.827643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827609    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/623fc414-12dd-4832-aa99-074449419721-dbus\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.827643 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:22.827642    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:23.32762129 +0000 UTC m=+3.179235442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:22.827891 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7585c233-ad19-4b82-b85d-4474a2f3e31d-host-slash\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.827891 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827866    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7585c233-ad19-4b82-b85d-4474a2f3e31d-iptables-alerter-script\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.828000 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827938    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/623fc414-12dd-4832-aa99-074449419721-kubelet-config\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:22.828000 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.827940    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7585c233-ad19-4b82-b85d-4474a2f3e31d-host-slash\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.828320 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.828298    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ebb3925-f327-4dfd-ae03-b977412f6bdb-konnectivity-ca\") pod \"konnectivity-agent-zxdfg\" (UID: \"3ebb3925-f327-4dfd-ae03-b977412f6bdb\") " pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.831293 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.831268    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ebb3925-f327-4dfd-ae03-b977412f6bdb-agent-certs\") pod \"konnectivity-agent-zxdfg\" (UID: \"3ebb3925-f327-4dfd-ae03-b977412f6bdb\") " pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.839775 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.839749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqm8g\" (UniqueName: \"kubernetes.io/projected/7585c233-ad19-4b82-b85d-4474a2f3e31d-kube-api-access-wqm8g\") pod \"iptables-alerter-8bw94\" (UID: \"7585c233-ad19-4b82-b85d-4474a2f3e31d\") " pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.865637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.865564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7"
Jul 07 16:18:22.876379 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.876355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fr9dd"
Jul 07 16:18:22.877161 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.877131    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0312b586_05bb_4a28_9a24_4a27797223dd.slice/crio-76ebb25f9effcf2ef42fd46cb59e84808db8420531f1ccbd58506e43a5930673 WatchSource:0}: Error finding container 76ebb25f9effcf2ef42fd46cb59e84808db8420531f1ccbd58506e43a5930673: Status 404 returned error can't find the container with id 76ebb25f9effcf2ef42fd46cb59e84808db8420531f1ccbd58506e43a5930673
Jul 07 16:18:22.885881 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.885857    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cbw7m"
Jul 07 16:18:22.886781 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.886757    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dad78b_587d_46cf_a754_d8c3785b4767.slice/crio-f1029eb756a8b046921433a5486ebd13f940433d267a468d9c8dc9f34c5cec5b WatchSource:0}: Error finding container f1029eb756a8b046921433a5486ebd13f940433d267a468d9c8dc9f34c5cec5b: Status 404 returned error can't find the container with id f1029eb756a8b046921433a5486ebd13f940433d267a468d9c8dc9f34c5cec5b
Jul 07 16:18:22.891193 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.891032    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-76wvn"
Jul 07 16:18:22.898112 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.898092    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:22.899640 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.899618    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0eb0c0_a23a_4d82_b558_8efa1860ff9a.slice/crio-2f14a5edca3a65d6505b8f7144adf2db3bfef0bae81581965b62cde239e0a882 WatchSource:0}: Error finding container 2f14a5edca3a65d6505b8f7144adf2db3bfef0bae81581965b62cde239e0a882: Status 404 returned error can't find the container with id 2f14a5edca3a65d6505b8f7144adf2db3bfef0bae81581965b62cde239e0a882
Jul 07 16:18:22.902900 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.902878    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f935075_bc63_417d_bc19_e0b6ddd3b6e0.slice/crio-f05d8b4bd593d5f175c1058fe73afd08a4263407de4812b39757a3a0eafcec7a WatchSource:0}: Error finding container f05d8b4bd593d5f175c1058fe73afd08a4263407de4812b39757a3a0eafcec7a: Status 404 returned error can't find the container with id f05d8b4bd593d5f175c1058fe73afd08a4263407de4812b39757a3a0eafcec7a
Jul 07 16:18:22.905933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.905908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-khnvq"
Jul 07 16:18:22.910362 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.910336    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50a5804_912f_431f_87e2_8b1f5fddafa8.slice/crio-611fd9e2e2af9617e38559b6f15e715d443d01c7016c6c00b12784101c7aac4b WatchSource:0}: Error finding container 611fd9e2e2af9617e38559b6f15e715d443d01c7016c6c00b12784101c7aac4b: Status 404 returned error can't find the container with id 611fd9e2e2af9617e38559b6f15e715d443d01c7016c6c00b12784101c7aac4b
Jul 07 16:18:22.916936 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.916909    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xxl8"
Jul 07 16:18:22.922001 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.921955    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41daa32_170a_4b6b_8597_9fcc3e840e25.slice/crio-a81c82e359abf6acc4b51b738139d1ce0c0002782015820288fd2c687375fa09 WatchSource:0}: Error finding container a81c82e359abf6acc4b51b738139d1ce0c0002782015820288fd2c687375fa09: Status 404 returned error can't find the container with id a81c82e359abf6acc4b51b738139d1ce0c0002782015820288fd2c687375fa09
Jul 07 16:18:22.922370 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.922198    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:22.930625 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.930473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8bw94"
Jul 07 16:18:22.930769 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:22.930722    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:22.933463 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.933440    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53257505_275e_41f3_ab08_924aee1fc3fd.slice/crio-d2a42ef7d83eda3fdf5f955761ad1e6d3055275761627f9ab10a5121e5a5ffc1 WatchSource:0}: Error finding container d2a42ef7d83eda3fdf5f955761ad1e6d3055275761627f9ab10a5121e5a5ffc1: Status 404 returned error can't find the container with id d2a42ef7d83eda3fdf5f955761ad1e6d3055275761627f9ab10a5121e5a5ffc1
Jul 07 16:18:22.937185 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.937158    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebb3925_f327_4dfd_ae03_b977412f6bdb.slice/crio-32d0c0f4ce05b5699967dac3f568d08cd570089a81b027c52d9602f65ab4c6c6 WatchSource:0}: Error finding container 32d0c0f4ce05b5699967dac3f568d08cd570089a81b027c52d9602f65ab4c6c6: Status 404 returned error can't find the container with id 32d0c0f4ce05b5699967dac3f568d08cd570089a81b027c52d9602f65ab4c6c6
Jul 07 16:18:22.949095 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:22.949066    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7585c233_ad19_4b82_b85d_4474a2f3e31d.slice/crio-6d66cde8964000adcfa3ca4dded62116df6bc8699d45ade974a67fb40bc3a8f4 WatchSource:0}: Error finding container 6d66cde8964000adcfa3ca4dded62116df6bc8699d45ade974a67fb40bc3a8f4: Status 404 returned error can't find the container with id 6d66cde8964000adcfa3ca4dded62116df6bc8699d45ade974a67fb40bc3a8f4
Jul 07 16:18:23.230065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.229981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:23.230231 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.230124    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:23.230231 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.230200    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:24.230180609 +0000 UTC m=+4.081794766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:23.331182 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.331136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:23.331375 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.331203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:23.331375 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.331343    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:23.331499 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.331380    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:23.331499 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.331410    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:23.331499 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.331414    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:24.331393283 +0000 UTC m=+4.183007437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:23.331499 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.331426    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:23.331499 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.331482    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:24.331464378 +0000 UTC m=+4.183078547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:23.621211 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.621090    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:13:22 +0000 UTC" deadline="2027-12-02 09:14:27.409325994 +0000 UTC"
Jul 07 16:18:23.621211 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.621131    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12304h56m3.788201836s"
Jul 07 16:18:23.653850 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.653817    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:23.654019 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:23.653956    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:23.663990 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.663927    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cbw7m" event={"ID":"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a","Type":"ContainerStarted","Data":"2f14a5edca3a65d6505b8f7144adf2db3bfef0bae81581965b62cde239e0a882"}
Jul 07 16:18:23.665568 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.665509    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerStarted","Data":"f1029eb756a8b046921433a5486ebd13f940433d267a468d9c8dc9f34c5cec5b"}
Jul 07 16:18:23.667669 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.667565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"611fd9e2e2af9617e38559b6f15e715d443d01c7016c6c00b12784101c7aac4b"}
Jul 07 16:18:23.669442 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.669358    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7" event={"ID":"0312b586-05bb-4a28-9a24-4a27797223dd","Type":"ContainerStarted","Data":"76ebb25f9effcf2ef42fd46cb59e84808db8420531f1ccbd58506e43a5930673"}
Jul 07 16:18:23.671198 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.671148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8bw94" event={"ID":"7585c233-ad19-4b82-b85d-4474a2f3e31d","Type":"ContainerStarted","Data":"6d66cde8964000adcfa3ca4dded62116df6bc8699d45ade974a67fb40bc3a8f4"}
Jul 07 16:18:23.672548 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.672497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zxdfg" event={"ID":"3ebb3925-f327-4dfd-ae03-b977412f6bdb","Type":"ContainerStarted","Data":"32d0c0f4ce05b5699967dac3f568d08cd570089a81b027c52d9602f65ab4c6c6"}
Jul 07 16:18:23.673733 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.673701    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xxl8" event={"ID":"53257505-275e-41f3-ab08-924aee1fc3fd","Type":"ContainerStarted","Data":"d2a42ef7d83eda3fdf5f955761ad1e6d3055275761627f9ab10a5121e5a5ffc1"}
Jul 07 16:18:23.675043 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.674982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-khnvq" event={"ID":"d41daa32-170a-4b6b-8597-9fcc3e840e25","Type":"ContainerStarted","Data":"a81c82e359abf6acc4b51b738139d1ce0c0002782015820288fd2c687375fa09"}
Jul 07 16:18:23.676182 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:23.676133    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-76wvn" event={"ID":"5f935075-bc63-417d-bc19-e0b6ddd3b6e0","Type":"ContainerStarted","Data":"f05d8b4bd593d5f175c1058fe73afd08a4263407de4812b39757a3a0eafcec7a"}
Jul 07 16:18:24.239597 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.239555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:24.239821 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.239724    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:24.239821 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.239797    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:26.239777004 +0000 UTC m=+6.091391163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:24.341012 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.340959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:24.341202 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.341049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:24.341271 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.341204    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:24.341271 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.341268    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:26.341246795 +0000 UTC m=+6.192860950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:24.341387 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.341366    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:24.341387 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.341382    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:24.341491 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.341395    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:24.341491 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.341438    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:26.341424256 +0000 UTC m=+6.193038415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:24.622402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.622256    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:13:22 +0000 UTC" deadline="2028-04-16 01:46:22.742151704 +0000 UTC"
Jul 07 16:18:24.622402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.622323    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15561h27m58.119832768s"
Jul 07 16:18:24.656540 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.655807    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:24.656540 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.655956    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:24.656540 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:24.656368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:24.656540 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:24.656473    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:25.653806 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:25.653554    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:25.654290 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:25.653910    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:25.695530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:25.695497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal" event={"ID":"dde6cf80b51827f1dbc1de58a509a849","Type":"ContainerStarted","Data":"040c4a260074052606b4f334ab6821f2c8f80760ad59bdf0cab346a343e28ee6"}
Jul 07 16:18:26.263195 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.262502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:26.263195 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.262713    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:26.263195 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.262771    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:30.262754181 +0000 UTC m=+10.114368335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:26.363210 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.363168    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:26.363389 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.363229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:26.363389 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.363368    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:26.363500 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.363431    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:30.363410963 +0000 UTC m=+10.215025132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:26.363860 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.363835    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:26.363860 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.363857    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:26.364031 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.363871    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:26.364031 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.363914    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:30.363899544 +0000 UTC m=+10.215513711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:26.652881 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.652792    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:26.653050 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.652937    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:26.653359 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.653339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:26.653470 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:26.653440    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:26.705718 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.705646    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal" event={"ID":"7ed45cc5e111bc2d8ba09694a5ee017d","Type":"ContainerStarted","Data":"51cd952b486cbea47b4065a1511fa63b12b29ceae8f7853e9fc8dd2abc0dbb90"}
Jul 07 16:18:26.723706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:26.723159    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-243.ec2.internal" podStartSLOduration=4.723141 podStartE2EDuration="4.723141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:25.711819458 +0000 UTC m=+5.563433632" watchObservedRunningTime="2026-07-07 16:18:26.723141 +0000 UTC m=+6.574755177"
Jul 07 16:18:27.652791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:27.652760    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:27.652988 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:27.652888    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:27.708967 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:27.708921    2573 generic.go:356] "Generic (PLEG): container finished" podID="7ed45cc5e111bc2d8ba09694a5ee017d" containerID="51cd952b486cbea47b4065a1511fa63b12b29ceae8f7853e9fc8dd2abc0dbb90" exitCode=0
Jul 07 16:18:27.709568 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:27.709203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal" event={"ID":"7ed45cc5e111bc2d8ba09694a5ee017d","Type":"ContainerDied","Data":"51cd952b486cbea47b4065a1511fa63b12b29ceae8f7853e9fc8dd2abc0dbb90"}
Jul 07 16:18:28.653318 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:28.653239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:28.653488 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:28.653369    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:28.653986 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:28.653798    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:28.653986 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:28.653915    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:29.653469 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:29.653436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:29.653915 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:29.653567    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:30.293506 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:30.293472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:30.293699 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.293634    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:30.293764 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.293705    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:38.293684134 +0000 UTC m=+18.145298284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:30.394827 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:30.394786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:30.395000 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:30.394861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:30.395000 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.394983    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:30.395000 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.394991    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:30.395146 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.395008    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:30.395146 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.395019    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:30.395146 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.395046    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:38.395028195 +0000 UTC m=+18.246642360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:30.395146 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.395064    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:38.395054618 +0000 UTC m=+18.246668769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:30.656317 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:30.656247    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:30.656721 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.656361    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:30.656721 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:30.656542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:30.656721 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:30.656674    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:31.653529 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:31.653495    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:31.653700 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:31.653625    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:32.657161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:32.657128    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:32.657632 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:32.657246    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:32.657632 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:32.657602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:32.657766 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:32.657711    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:33.653106 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.653076    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:33.653243 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:33.653215    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:33.726830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.726681    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7" event={"ID":"0312b586-05bb-4a28-9a24-4a27797223dd","Type":"ContainerStarted","Data":"202be92de2e116eb9943e8d609ab29e4ec848b8a0ab262391fad06df15277e1c"}
Jul 07 16:18:33.733968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.733918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal" event={"ID":"7ed45cc5e111bc2d8ba09694a5ee017d","Type":"ContainerStarted","Data":"c1f409284c375bfec77d37c75fbb497a12576e2488a1277d759f0be4040269c1"}
Jul 07 16:18:33.739337 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.739257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-khnvq" event={"ID":"d41daa32-170a-4b6b-8597-9fcc3e840e25","Type":"ContainerStarted","Data":"40d3406aed51418c2cfc56454556e0d3be5a57e6b668291c2df003e1ae6d4a7f"}
Jul 07 16:18:33.741096 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.741036    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cbw7m" event={"ID":"ed0eb0c0-a23a-4d82-b558-8efa1860ff9a","Type":"ContainerStarted","Data":"da256fd757194beb9bc69da5ffbf9a9cb22c955d27d8f203c1e8ea44e672f132"}
Jul 07 16:18:33.763239 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.763190    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-khnvq" podStartSLOduration=2.315205881 podStartE2EDuration="12.763172582s" totalImagesPullingTime="10.447966701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:33.762392015 +0000 UTC m=+13.614006188" watchObservedRunningTime="2026-07-07 16:18:33.763172582 +0000 UTC m=+13.614786756"
Jul 07 16:18:33.779834 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:33.779631    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-243.ec2.internal" podStartSLOduration=11.779613095 podStartE2EDuration="11.779613095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:33.779145256 +0000 UTC m=+13.630759434" watchObservedRunningTime="2026-07-07 16:18:33.779613095 +0000 UTC m=+13.631227269"
Jul 07 16:18:34.653595 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.653421    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:34.653683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.653496    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:34.653749 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:34.653694    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:34.653800 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:34.653761    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:34.745026 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.744987    2573 generic.go:356] "Generic (PLEG): container finished" podID="18dad78b-587d-46cf-a754-d8c3785b4767" containerID="9ba5392497794e819384ca9505052015d78bb370b7a6f4e697397e3fb1d04f0e" exitCode=0
Jul 07 16:18:34.745437 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.745080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerDied","Data":"9ba5392497794e819384ca9505052015d78bb370b7a6f4e697397e3fb1d04f0e"}
Jul 07 16:18:34.746944 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.746916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8bw94" event={"ID":"7585c233-ad19-4b82-b85d-4474a2f3e31d","Type":"ContainerStarted","Data":"aaf52838ab0a201ad09d42af4c04dd6a5cf69ea5f1697880a7daa43786e6a2f6"}
Jul 07 16:18:34.748845 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.748815    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zxdfg" event={"ID":"3ebb3925-f327-4dfd-ae03-b977412f6bdb","Type":"ContainerStarted","Data":"f4e949a4969786417de67dc9610c6583dc3e8f7d62b41f86ead5afd539cbafea"}
Jul 07 16:18:34.750976 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.750932    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xxl8" event={"ID":"53257505-275e-41f3-ab08-924aee1fc3fd","Type":"ContainerStarted","Data":"bb183bc14c5fd8c05cbf156ea409024452828b8265bd1a8bbc6e6d0b7c2f65e9"}
Jul 07 16:18:34.768864 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.768819    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cbw7m" podStartSLOduration=3.297922673 podStartE2EDuration="13.768803501s" totalImagesPullingTime="10.470880828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:33.794108255 +0000 UTC m=+13.645722429" watchObservedRunningTime="2026-07-07 16:18:34.768803501 +0000 UTC m=+14.620417677"
Jul 07 16:18:34.783473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.783431    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zxdfg" podStartSLOduration=3.333361358 podStartE2EDuration="13.783418815s" totalImagesPullingTime="10.450057457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:34.782703661 +0000 UTC m=+14.634317837" watchObservedRunningTime="2026-07-07 16:18:34.783418815 +0000 UTC m=+14.635032992"
Jul 07 16:18:34.801443 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.800198    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8bw94" podStartSLOduration=3.380358497 podStartE2EDuration="13.800181273s" totalImagesPullingTime="10.419822776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:34.799151794 +0000 UTC m=+14.650765968" watchObservedRunningTime="2026-07-07 16:18:34.800181273 +0000 UTC m=+14.651795447"
Jul 07 16:18:34.820244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.820201    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9xxl8" podStartSLOduration=3.027005841 podStartE2EDuration="13.820188103s" totalImagesPullingTime="10.793182262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:34.820124593 +0000 UTC m=+14.671738783" watchObservedRunningTime="2026-07-07 16:18:34.820188103 +0000 UTC m=+14.671802277"
Jul 07 16:18:34.972123 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.972048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:34.972666 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:34.972637    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:35.652709 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:35.652682    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:35.652869 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:35.652805    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:36.653601 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:36.653569    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:36.654190 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:36.653707    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:36.654190 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:36.653747    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:36.654190 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:36.653826    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:36.755599 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:36.755570    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 16:18:37.653708 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:37.653674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:37.654452 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:37.653787    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:38.354727 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:38.354689    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:38.354874 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.354836    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:38.354918 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.354906    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:54.354891388 +0000 UTC m=+34.206505540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:38.455556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:38.455521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:38.455744 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:38.455585    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:38.455744 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.455692    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:38.455744 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.455704    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:38.455744 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.455725    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:38.455744 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.455738    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:38.455933 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.455753    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:54.455735208 +0000 UTC m=+34.307349364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:38.455933 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.455787    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:54.455771271 +0000 UTC m=+34.307385428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:38.653902 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:38.653816    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:38.653902 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:38.653829    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:38.654544 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.653981    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:38.654544 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:38.654137    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:39.653255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:39.653228    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:39.653429 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:39.653335    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:40.654188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:40.654156    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:40.654632 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:40.654275    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:40.654632 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:40.654606    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:40.654719 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:40.654672    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:41.653742 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:41.653706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:41.653919 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:41.653830    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:42.653517 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:42.653477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:42.654233 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:42.654180    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:42.654395 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:42.654376    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:42.654681 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:42.654653    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:43.103398 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.103216    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 16:18:43.653723 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.653456    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:18:43.103396019Z","UUID":"9905d170-31d1-40c1-9e16-efd0f5c77531","Handler":null,"Name":"","Endpoint":""}
Jul 07 16:18:43.653723 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.653543    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:43.654221 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:43.653835    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:43.655080 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.655062    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 16:18:43.655207 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.655099    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 16:18:43.773253 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.773089    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-76wvn" event={"ID":"5f935075-bc63-417d-bc19-e0b6ddd3b6e0","Type":"ContainerStarted","Data":"c8e48651de7d34381827de2102541fb48ac7904a551d95eaea643f4cd0667d30"}
Jul 07 16:18:43.776140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776120    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:18:43.776548 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776525    2573 generic.go:356] "Generic (PLEG): container finished" podID="c50a5804-912f-431f-87e2-8b1f5fddafa8" containerID="59df6f794cca741f80d3c53bfe170d2be419a694f85f5d69fbd2f94b073474c8" exitCode=1
Jul 07 16:18:43.776617 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"8d50269ffbb92c19f3abe4ac7663af821d6bde2ebc64b76404e39ab0caa2b8f6"}
Jul 07 16:18:43.776669 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"9f7cc051cdfbbb62c6cf1ca253bb25ea036aa5e0e5268a14c6b4ff2965a18f03"}
Jul 07 16:18:43.776724 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"8beee948f120b30b6b82d6bba0252a24abc07af73808941ae2a908c28e08d84f"}
Jul 07 16:18:43.776775 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776736    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"b619ce72add0d474e21eef264a1369337c96b7fdfe0fff8f8f6513a1be5ca170"}
Jul 07 16:18:43.776832 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776785    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerDied","Data":"59df6f794cca741f80d3c53bfe170d2be419a694f85f5d69fbd2f94b073474c8"}
Jul 07 16:18:43.776884 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.776834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"8d3017485eeefc3e8a93ead4e594ccaa8a8a8f325cf68c996db20fbf26e53c9a"}
Jul 07 16:18:43.778476 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.778455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7" event={"ID":"0312b586-05bb-4a28-9a24-4a27797223dd","Type":"ContainerStarted","Data":"654de19b028366e3195d3e406e51c578d82dc59c394eff47ee454f5f4b6a5d5a"}
Jul 07 16:18:43.790223 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:43.790184    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-76wvn" podStartSLOduration=2.751791611 podStartE2EDuration="22.790171736s" totalImagesPullingTime="20.038380125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:43.789558151 +0000 UTC m=+23.641172338" watchObservedRunningTime="2026-07-07 16:18:43.790171736 +0000 UTC m=+23.641785910"
Jul 07 16:18:44.653511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:44.653475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:44.653794 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:44.653588    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:44.653794 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:44.653646    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:44.653794 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:44.653767    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:45.653101 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:45.653073    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:45.653205 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:45.653164    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:46.653701 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.653669    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:46.654244 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:46.653789    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:46.654244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.653837    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:46.654244 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:46.653931    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:46.786217 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.786180    2573 generic.go:356] "Generic (PLEG): container finished" podID="18dad78b-587d-46cf-a754-d8c3785b4767" containerID="82bac1b5c5cb24d13cc419d17b07c4efa41f6dfc2101ca289d7e8a00aec4b1b4" exitCode=0
Jul 07 16:18:46.786391 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.786262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerDied","Data":"82bac1b5c5cb24d13cc419d17b07c4efa41f6dfc2101ca289d7e8a00aec4b1b4"}
Jul 07 16:18:46.789388 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.789372    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:18:46.789765 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.789740    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"b7257e1fc95f1bd5d01dcd2554644e320c06a165690c182fcdadd81abe288281"}
Jul 07 16:18:46.791683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.791663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7" event={"ID":"0312b586-05bb-4a28-9a24-4a27797223dd","Type":"ContainerStarted","Data":"afbcb4a137a8e00b9289d156d8b5c84f9f44a3accc681c40c552b0ef3b68d29f"}
Jul 07 16:18:46.837199 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:46.837159    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pcwt7" podStartSLOduration=3.359588061 podStartE2EDuration="25.837145863s" totalImagesPullingTime="22.477557802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:46.836572455 +0000 UTC m=+26.688186629" watchObservedRunningTime="2026-07-07 16:18:46.837145863 +0000 UTC m=+26.688760330"
Jul 07 16:18:47.653086 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:47.653054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:47.653304 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:47.653157    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:48.652912 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.652879    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:48.653580 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:48.653027    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:48.653580 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.653075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:48.653580 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:48.653160    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:48.798641 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.798614    2573 generic.go:356] "Generic (PLEG): container finished" podID="18dad78b-587d-46cf-a754-d8c3785b4767" containerID="e4a270a9bda659a01a1c095e21c76d142346f6fc6c7d3c6e1e7d4bd8023d3e32" exitCode=0
Jul 07 16:18:48.798786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.798689    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerDied","Data":"e4a270a9bda659a01a1c095e21c76d142346f6fc6c7d3c6e1e7d4bd8023d3e32"}
Jul 07 16:18:48.802215 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.802199    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:18:48.802545 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.802521    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"2cb7fcd35ee8ab8a28c3d4100622c719dbc721994ccf06ef0fe2018e78bb819a"}
Jul 07 16:18:48.802740 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.802726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:48.802816 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.802804    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:48.802918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.802904    2573 scope.go:117] "RemoveContainer" containerID="59df6f794cca741f80d3c53bfe170d2be419a694f85f5d69fbd2f94b073474c8"
Jul 07 16:18:48.818930 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:48.818912    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:49.652917 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:49.652889    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:49.653294 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:49.653008    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:49.808233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:49.808209    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:18:49.811348 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:49.811318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" event={"ID":"c50a5804-912f-431f-87e2-8b1f5fddafa8","Type":"ContainerStarted","Data":"f80ac82f872413de39465e5efd0eb982e3e1f5d981f5d47a6fc3e9b2bd38ee4a"}
Jul 07 16:18:49.811588 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:49.811571    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:49.826531 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:49.826500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:18:49.852675 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:49.852622    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f" podStartSLOduration=8.782465541 podStartE2EDuration="28.852608039s" totalImagesPullingTime="20.070142498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:49.852529072 +0000 UTC m=+29.704143284" watchObservedRunningTime="2026-07-07 16:18:49.852608039 +0000 UTC m=+29.704222212"
Jul 07 16:18:50.142284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.142253    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rk99f"]
Jul 07 16:18:50.142448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.142370    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:50.142512 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:50.142471    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:50.147187 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.147164    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkn26"]
Jul 07 16:18:50.147298 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.147257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:50.147397 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:50.147378    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:50.148017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.147997    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6gt2n"]
Jul 07 16:18:50.148107 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.148095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:50.148200 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:50.148176    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:50.815074 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.815042    2573 generic.go:356] "Generic (PLEG): container finished" podID="18dad78b-587d-46cf-a754-d8c3785b4767" containerID="6c9118831211a417d2188582c4ac8b5efd91e35995fdd11e07872615a8cc0591" exitCode=0
Jul 07 16:18:50.815418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:50.815124    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerDied","Data":"6c9118831211a417d2188582c4ac8b5efd91e35995fdd11e07872615a8cc0591"}
Jul 07 16:18:51.652776 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:51.652750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:51.652977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:51.652868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:51.652977 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:51.652874    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:51.653115 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:51.652996    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:51.653115 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:51.653053    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:51.653202 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:51.653127    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:52.801658 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:52.801538    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:52.802108 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:52.801777    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 16:18:52.802830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:52.802805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zxdfg"
Jul 07 16:18:53.653365 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:53.653336    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:53.653365 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:53.653341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:53.653704 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:53.653341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:53.653704 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:53.653458    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:53.653704 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:53.653514    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:53.653704 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:53.653627    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:54.367587 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:54.367559    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:54.368119 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.367679    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:54.368119 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.367735    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs podName:e5e9be16-5f7b-441e-95f9-6a456aaa8cc6 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:26.367718373 +0000 UTC m=+66.219332524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs") pod "network-metrics-daemon-6gt2n" (UID: "e5e9be16-5f7b-441e-95f9-6a456aaa8cc6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:54.468603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:54.468570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:54.468763 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:54.468633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:54.468763 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.468743    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:54.468763 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.468755    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:54.468763 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.468766    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:54.468986 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.468779    2573 projected.go:196] Error preparing data for projected volume kube-api-access-tqklf for pod openshift-network-diagnostics/network-check-target-rk99f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:54.468986 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.468820    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret podName:623fc414-12dd-4832-aa99-074449419721 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:26.468801247 +0000 UTC m=+66.320415438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret") pod "global-pull-secret-syncer-xkn26" (UID: "623fc414-12dd-4832-aa99-074449419721") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:54.468986 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:54.468837    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf podName:69b91335-daa6-45f6-aa44-63a87370204d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:26.468829861 +0000 UTC m=+66.320444014 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tqklf" (UniqueName: "kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf") pod "network-check-target-rk99f" (UID: "69b91335-daa6-45f6-aa44-63a87370204d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:55.652891 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:55.652861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:55.653397 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:55.652861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:55.653397 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:55.652990    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rk99f" podUID="69b91335-daa6-45f6-aa44-63a87370204d"
Jul 07 16:18:55.653397 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:55.652861    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:55.653397 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:55.653064    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6gt2n" podUID="e5e9be16-5f7b-441e-95f9-6a456aaa8cc6"
Jul 07 16:18:55.653397 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:55.653117    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xkn26" podUID="623fc414-12dd-4832-aa99-074449419721"
Jul 07 16:18:56.833969 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.833916    2573 generic.go:356] "Generic (PLEG): container finished" podID="18dad78b-587d-46cf-a754-d8c3785b4767" containerID="9a3c4e3d0be3fd556a268d6da1326bc22133644f3d713955f3639d981458a01a" exitCode=0
Jul 07 16:18:56.834577 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.833985    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerDied","Data":"9a3c4e3d0be3fd556a268d6da1326bc22133644f3d713955f3639d981458a01a"}
Jul 07 16:18:56.899632 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.899613    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-243.ec2.internal" event="NodeReady"
Jul 07 16:18:56.899734 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.899722    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 16:18:56.945254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.945231    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2rmd6"]
Jul 07 16:18:56.949040 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.949011    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:56.949125 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.949073    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hsg7w"]
Jul 07 16:18:56.951196 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.951175    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 16:18:56.951486 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.951466    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 16:18:56.951552 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.951510    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sv27\""
Jul 07 16:18:56.951627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.951612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:56.953461 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.953444    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 16:18:56.953728 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.953713    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 16:18:56.953764 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.953754    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 16:18:56.953796 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.953718    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5hz4f\""
Jul 07 16:18:56.961791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.961771    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rmd6"]
Jul 07 16:18:56.967561 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.967543    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hsg7w"]
Jul 07 16:18:56.985529 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.985509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bfec422-23c8-4bc5-831d-4f8262019c27-config-volume\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:56.985620 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.985537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrjf\" (UniqueName: \"kubernetes.io/projected/eea8e3d9-c509-42ed-b99a-30b220afc51f-kube-api-access-ffrjf\") pod \"ingress-canary-hsg7w\" (UID: \"eea8e3d9-c509-42ed-b99a-30b220afc51f\") " pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:56.985620 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.985576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eea8e3d9-c509-42ed-b99a-30b220afc51f-cert\") pod \"ingress-canary-hsg7w\" (UID: \"eea8e3d9-c509-42ed-b99a-30b220afc51f\") " pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:56.985620 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.985612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:56.985735 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.985674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qwp\" (UniqueName: \"kubernetes.io/projected/3bfec422-23c8-4bc5-831d-4f8262019c27-kube-api-access-42qwp\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:56.985735 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:56.985705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bfec422-23c8-4bc5-831d-4f8262019c27-tmp-dir\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.086032 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.085968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bfec422-23c8-4bc5-831d-4f8262019c27-config-volume\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.086032 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.086007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrjf\" (UniqueName: \"kubernetes.io/projected/eea8e3d9-c509-42ed-b99a-30b220afc51f-kube-api-access-ffrjf\") pod \"ingress-canary-hsg7w\" (UID: \"eea8e3d9-c509-42ed-b99a-30b220afc51f\") " pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:57.086187 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.086047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eea8e3d9-c509-42ed-b99a-30b220afc51f-cert\") pod \"ingress-canary-hsg7w\" (UID: \"eea8e3d9-c509-42ed-b99a-30b220afc51f\") " pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:57.086187 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.086062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.086187 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.086084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qwp\" (UniqueName: \"kubernetes.io/projected/3bfec422-23c8-4bc5-831d-4f8262019c27-kube-api-access-42qwp\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.086187 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.086108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bfec422-23c8-4bc5-831d-4f8262019c27-tmp-dir\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.086354 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:57.086227    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:18:57.086354 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:57.086283    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls podName:3bfec422-23c8-4bc5-831d-4f8262019c27 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:57.586265598 +0000 UTC m=+37.437879750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls") pod "dns-default-2rmd6" (UID: "3bfec422-23c8-4bc5-831d-4f8262019c27") : secret "dns-default-metrics-tls" not found
Jul 07 16:18:57.086562 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.086542    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bfec422-23c8-4bc5-831d-4f8262019c27-config-volume\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.087066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.087048    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bfec422-23c8-4bc5-831d-4f8262019c27-tmp-dir\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.090232 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.090213    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eea8e3d9-c509-42ed-b99a-30b220afc51f-cert\") pod \"ingress-canary-hsg7w\" (UID: \"eea8e3d9-c509-42ed-b99a-30b220afc51f\") " pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:57.095690 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.095667    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrjf\" (UniqueName: \"kubernetes.io/projected/eea8e3d9-c509-42ed-b99a-30b220afc51f-kube-api-access-ffrjf\") pod \"ingress-canary-hsg7w\" (UID: \"eea8e3d9-c509-42ed-b99a-30b220afc51f\") " pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:57.095901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.095885    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qwp\" (UniqueName: \"kubernetes.io/projected/3bfec422-23c8-4bc5-831d-4f8262019c27-kube-api-access-42qwp\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.301021 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.300991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hsg7w"
Jul 07 16:18:57.436970 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.436930    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hsg7w"]
Jul 07 16:18:57.440687 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:18:57.440662    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea8e3d9_c509_42ed_b99a_30b220afc51f.slice/crio-e7950ed31b7f6789d5af0591415da43b921b1ff3819a03574df351b3cb107b06 WatchSource:0}: Error finding container e7950ed31b7f6789d5af0591415da43b921b1ff3819a03574df351b3cb107b06: Status 404 returned error can't find the container with id e7950ed31b7f6789d5af0591415da43b921b1ff3819a03574df351b3cb107b06
Jul 07 16:18:57.589150 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.589117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:57.589298 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:57.589245    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:18:57.589362 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:57.589306    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls podName:3bfec422-23c8-4bc5-831d-4f8262019c27 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:58.589288884 +0000 UTC m=+38.440903035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls") pod "dns-default-2rmd6" (UID: "3bfec422-23c8-4bc5-831d-4f8262019c27") : secret "dns-default-metrics-tls" not found
Jul 07 16:18:57.653708 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.653672    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:18:57.653822 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.653780    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:18:57.653999 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.653933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:18:57.656343 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.656325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nbnd\""
Jul 07 16:18:57.656343 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.656335    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 16:18:57.656497 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.656325    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 16:18:57.656497 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.656335    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:18:57.656497 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.656337    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwt\""
Jul 07 16:18:57.656497 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.656325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:18:57.837487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.837450    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hsg7w" event={"ID":"eea8e3d9-c509-42ed-b99a-30b220afc51f","Type":"ContainerStarted","Data":"e7950ed31b7f6789d5af0591415da43b921b1ff3819a03574df351b3cb107b06"}
Jul 07 16:18:57.840342 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.840319    2573 generic.go:356] "Generic (PLEG): container finished" podID="18dad78b-587d-46cf-a754-d8c3785b4767" containerID="db3487323b56f46b6836c6b8949329446242078cdacaee7472eba8ee4b10ce94" exitCode=0
Jul 07 16:18:57.840452 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:57.840350    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerDied","Data":"db3487323b56f46b6836c6b8949329446242078cdacaee7472eba8ee4b10ce94"}
Jul 07 16:18:58.596117 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:58.596080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:18:58.596455 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:58.596432    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:18:58.596522 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:18:58.596513    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls podName:3bfec422-23c8-4bc5-831d-4f8262019c27 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:00.596493186 +0000 UTC m=+40.448107352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls") pod "dns-default-2rmd6" (UID: "3bfec422-23c8-4bc5-831d-4f8262019c27") : secret "dns-default-metrics-tls" not found
Jul 07 16:18:58.847484 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:58.847394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" event={"ID":"18dad78b-587d-46cf-a754-d8c3785b4767","Type":"ContainerStarted","Data":"833d992e6dbbab3ef8f3213cab575d61400c9f85e78d6ef7d91eb879a50bb218"}
Jul 07 16:18:58.873776 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:18:58.873727    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fr9dd" podStartSLOduration=8.434364929000001 podStartE2EDuration="37.873712565s" totalImagesPullingTime="29.439347636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:58.872228365 +0000 UTC m=+38.723842538" watchObservedRunningTime="2026-07-07 16:18:58.873712565 +0000 UTC m=+38.725326738"
Jul 07 16:19:00.611861 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:00.611626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:00.611861 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:00.611776    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:00.612317 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:00.611868    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls podName:3bfec422-23c8-4bc5-831d-4f8262019c27 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:04.611852074 +0000 UTC m=+44.463466225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls") pod "dns-default-2rmd6" (UID: "3bfec422-23c8-4bc5-831d-4f8262019c27") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:00.853402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:00.853366    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hsg7w" event={"ID":"eea8e3d9-c509-42ed-b99a-30b220afc51f","Type":"ContainerStarted","Data":"be9c201b53ea61307290c865dd991a49fb66a21647e886f2123d76062b7a4a99"}
Jul 07 16:19:00.869231 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:00.869138    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hsg7w" podStartSLOduration=1.974121123 podStartE2EDuration="4.869119094s" totalImagesPullingTime="2.894997971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:00.868720514 +0000 UTC m=+40.720334688" watchObservedRunningTime="2026-07-07 16:19:00.869119094 +0000 UTC m=+40.720733268"
Jul 07 16:19:01.039896 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.039863    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"]
Jul 07 16:19:01.061659 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.061633    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bc9946d6c-2zf4h"]
Jul 07 16:19:01.062397 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.062368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.064843 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.064820    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 16:19:01.065001 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.064898    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nrpxf\""
Jul 07 16:19:01.065165 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.065069    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 16:19:01.065262 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.065202    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 16:19:01.065328 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.065260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:19:01.085682 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.085662    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9444f6d97-mqkjw"]
Jul 07 16:19:01.085821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.085781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.088157 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088137    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 16:19:01.088253 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088147    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 16:19:01.088336 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088321    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 16:19:01.088456 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088416    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 16:19:01.088598 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 16:19:01.088638 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088585    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9zxs8\""
Jul 07 16:19:01.088835 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.088821    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 16:19:01.109725 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.109703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc9946d6c-2zf4h"]
Jul 07 16:19:01.109839 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.109737    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"]
Jul 07 16:19:01.109839 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.109756    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9444f6d97-mqkjw"]
Jul 07 16:19:01.109966 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.109848    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.111990 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.111971    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 16:19:01.112153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.112135    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 16:19:01.112213 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.112157    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 16:19:01.112213 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.112180    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9zlp\""
Jul 07 16:19:01.115258 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.115234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b113e6c-ecf4-4691-bf5d-7886395a8806-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.115424 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.115405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkcv\" (UniqueName: \"kubernetes.io/projected/2b113e6c-ecf4-4691-bf5d-7886395a8806-kube-api-access-rvkcv\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.115552 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.115538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b113e6c-ecf4-4691-bf5d-7886395a8806-config\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.119760 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.119715    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 16:19:01.216226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b113e6c-ecf4-4691-bf5d-7886395a8806-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.216226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-stats-auth\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.216448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.216448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-bound-sa-token\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.216448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.216448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfts\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-kube-api-access-8jfts\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.216622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216483    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkcv\" (UniqueName: \"kubernetes.io/projected/2b113e6c-ecf4-4691-bf5d-7886395a8806-kube-api-access-rvkcv\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.216622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.216699 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v497n\" (UniqueName: \"kubernetes.io/projected/3fbe5de2-adb7-4c64-917e-224067117816-kube-api-access-v497n\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.216699 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-certificates\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.216699 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-installation-pull-secrets\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.216843 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216698    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-trusted-ca\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.216843 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b113e6c-ecf4-4691-bf5d-7886395a8806-config\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.216843 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-image-registry-private-configuration\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.217010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc27c1f1-9630-4691-ab70-b98636aa2b6d-ca-trust-extracted\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.217010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.216903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-default-certificate\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.217326 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.217306    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b113e6c-ecf4-4691-bf5d-7886395a8806-config\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.220126 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.220101    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b113e6c-ecf4-4691-bf5d-7886395a8806-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.224703 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.224681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkcv\" (UniqueName: \"kubernetes.io/projected/2b113e6c-ecf4-4691-bf5d-7886395a8806-kube-api-access-rvkcv\") pod \"service-ca-operator-5d46d9ffd4-l8kcb\" (UID: \"2b113e6c-ecf4-4691-bf5d-7886395a8806\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.238839 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.238816    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fwtrz"]
Jul 07 16:19:01.255892 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.255865    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.256396 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.256375    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fwtrz"]
Jul 07 16:19:01.258171 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.258154    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 16:19:01.258263 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.258192    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 16:19:01.258263 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.258257    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:19:01.258409 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.258382    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pwfl9\""
Jul 07 16:19:01.258465 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.258425    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 16:19:01.264205 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.264187    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 16:19:01.317556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317528    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc27c1f1-9630-4691-ab70-b98636aa2b6d-ca-trust-extracted\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.317556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b0e5183-067f-46dc-8ab4-5fea78445317-config\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.317706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-default-certificate\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.317706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e5183-067f-46dc-8ab4-5fea78445317-trusted-ca\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.317706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b0e5183-067f-46dc-8ab4-5fea78445317-serving-cert\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.317807 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-stats-auth\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.317807 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.317878 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-bound-sa-token\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.317921 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.317902    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:19:01.317921 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317911    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc27c1f1-9630-4691-ab70-b98636aa2b6d-ca-trust-extracted\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.318060 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.317923    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9444f6d97-mqkjw: secret "image-registry-tls" not found
Jul 07 16:19:01.318060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.317979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.318060 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.318009    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls podName:cc27c1f1-9630-4691-ab70-b98636aa2b6d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:01.817988345 +0000 UTC m=+41.669602515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls") pod "image-registry-9444f6d97-mqkjw" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d") : secret "image-registry-tls" not found
Jul 07 16:19:01.318060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318034    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfts\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-kube-api-access-8jfts\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.318088    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:01.818070464 +0000 UTC m=+41.669684620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : configmap references non-existent config key: service-ca.crt
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7p7w\" (UniqueName: \"kubernetes.io/projected/2b0e5183-067f-46dc-8ab4-5fea78445317-kube-api-access-c7p7w\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.318137    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.318179    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:01.818160348 +0000 UTC m=+41.669774505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : secret "router-metrics-certs-default" not found
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318196    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v497n\" (UniqueName: \"kubernetes.io/projected/3fbe5de2-adb7-4c64-917e-224067117816-kube-api-access-v497n\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-certificates\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.318261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-installation-pull-secrets\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.318593 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-trusted-ca\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.318593 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-image-registry-private-configuration\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.318871 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.318844    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-certificates\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.319555 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.319534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-trusted-ca\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.320206 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.320185    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-stats-auth\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.320318 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.320300    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-default-certificate\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.320824 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.320809    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-image-registry-private-configuration\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.320961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.320932    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-installation-pull-secrets\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.325527 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.325502    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v497n\" (UniqueName: \"kubernetes.io/projected/3fbe5de2-adb7-4c64-917e-224067117816-kube-api-access-v497n\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.325816 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.325798    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfts\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-kube-api-access-8jfts\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.325901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.325852    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-bound-sa-token\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.371829 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.371773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"
Jul 07 16:19:01.419019 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.418997    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e5183-067f-46dc-8ab4-5fea78445317-trusted-ca\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.419117 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.419032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b0e5183-067f-46dc-8ab4-5fea78445317-serving-cert\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.419173 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.419116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7p7w\" (UniqueName: \"kubernetes.io/projected/2b0e5183-067f-46dc-8ab4-5fea78445317-kube-api-access-c7p7w\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.419233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.419177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b0e5183-067f-46dc-8ab4-5fea78445317-config\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.419941 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.419917    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b0e5183-067f-46dc-8ab4-5fea78445317-config\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.420034 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.419969    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b0e5183-067f-46dc-8ab4-5fea78445317-trusted-ca\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.421837 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.421816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b0e5183-067f-46dc-8ab4-5fea78445317-serving-cert\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.427637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.427617    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7p7w\" (UniqueName: \"kubernetes.io/projected/2b0e5183-067f-46dc-8ab4-5fea78445317-kube-api-access-c7p7w\") pod \"console-operator-68b757fb67-fwtrz\" (UID: \"2b0e5183-067f-46dc-8ab4-5fea78445317\") " pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.532394 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.532211    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb"]
Jul 07 16:19:01.535798 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:01.535773    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b113e6c_ecf4_4691_bf5d_7886395a8806.slice/crio-e84f51afaacd1f731f511d3dafc57f43c4a1688dd6329ca1d7104d8081aadba0 WatchSource:0}: Error finding container e84f51afaacd1f731f511d3dafc57f43c4a1688dd6329ca1d7104d8081aadba0: Status 404 returned error can't find the container with id e84f51afaacd1f731f511d3dafc57f43c4a1688dd6329ca1d7104d8081aadba0
Jul 07 16:19:01.565945 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.565918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:01.697416 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.697388    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-fwtrz"]
Jul 07 16:19:01.701262 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:01.701236    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0e5183_067f_46dc_8ab4_5fea78445317.slice/crio-033aa4f739fc69ed38d532e8301536b7fd58b1135b997dd0af42862104d06fca WatchSource:0}: Error finding container 033aa4f739fc69ed38d532e8301536b7fd58b1135b997dd0af42862104d06fca: Status 404 returned error can't find the container with id 033aa4f739fc69ed38d532e8301536b7fd58b1135b997dd0af42862104d06fca
Jul 07 16:19:01.822496 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.822458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:01.822687 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.822511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.822687 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.822540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:01.822687 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.822659    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:19:01.822816 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.822691    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:19:01.822816 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.822663    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:02.822645275 +0000 UTC m=+42.674259425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : configmap references non-existent config key: service-ca.crt
Jul 07 16:19:01.822816 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.822708    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9444f6d97-mqkjw: secret "image-registry-tls" not found
Jul 07 16:19:01.822816 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.822727    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:02.822711934 +0000 UTC m=+42.674326089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : secret "router-metrics-certs-default" not found
Jul 07 16:19:01.822816 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:01.822781    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls podName:cc27c1f1-9630-4691-ab70-b98636aa2b6d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:02.822769085 +0000 UTC m=+42.674383239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls") pod "image-registry-9444f6d97-mqkjw" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d") : secret "image-registry-tls" not found
Jul 07 16:19:01.856441 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.856412    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" event={"ID":"2b0e5183-067f-46dc-8ab4-5fea78445317","Type":"ContainerStarted","Data":"033aa4f739fc69ed38d532e8301536b7fd58b1135b997dd0af42862104d06fca"}
Jul 07 16:19:01.857518 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:01.857495    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb" event={"ID":"2b113e6c-ecf4-4691-bf5d-7886395a8806","Type":"ContainerStarted","Data":"e84f51afaacd1f731f511d3dafc57f43c4a1688dd6329ca1d7104d8081aadba0"}
Jul 07 16:19:02.829356 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:02.829320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:02.829379    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:02.829404    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:02.829468    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:02.829488    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9444f6d97-mqkjw: secret "image-registry-tls" not found
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:02.829539    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls podName:cc27c1f1-9630-4691-ab70-b98636aa2b6d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:04.829522901 +0000 UTC m=+44.681137052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls") pod "image-registry-9444f6d97-mqkjw" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d") : secret "image-registry-tls" not found
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:02.829552    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:04.829546299 +0000 UTC m=+44.681160450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : configmap references non-existent config key: service-ca.crt
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:02.829593    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:19:02.829806 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:02.829650    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:04.829633949 +0000 UTC m=+44.681248120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : secret "router-metrics-certs-default" not found
Jul 07 16:19:04.646138 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:04.646095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:04.646618 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.646273    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:04.646618 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.646360    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls podName:3bfec422-23c8-4bc5-831d-4f8262019c27 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:12.646340959 +0000 UTC m=+52.497955110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls") pod "dns-default-2rmd6" (UID: "3bfec422-23c8-4bc5-831d-4f8262019c27") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:04.847885 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:04.847845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:04.848057 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:04.847895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:04.848057 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:04.847968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:04.848057 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.848033    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:08.848014629 +0000 UTC m=+48.699628800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : configmap references non-existent config key: service-ca.crt
Jul 07 16:19:04.848174 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.848058    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:19:04.848174 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.848073    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:19:04.848174 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.848083    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9444f6d97-mqkjw: secret "image-registry-tls" not found
Jul 07 16:19:04.848174 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.848099    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:08.848087888 +0000 UTC m=+48.699702049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : secret "router-metrics-certs-default" not found
Jul 07 16:19:04.848174 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:04.848128    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls podName:cc27c1f1-9630-4691-ab70-b98636aa2b6d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:08.848112318 +0000 UTC m=+48.699726489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls") pod "image-registry-9444f6d97-mqkjw" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d") : secret "image-registry-tls" not found
Jul 07 16:19:05.869856 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:05.869832    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/0.log"
Jul 07 16:19:05.870274 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:05.869871    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b0e5183-067f-46dc-8ab4-5fea78445317" containerID="66f63ce6781c3361ada9ffb6bac1283e71de5824fb932241bfc172127c5c2576" exitCode=255
Jul 07 16:19:05.870274 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:05.869942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" event={"ID":"2b0e5183-067f-46dc-8ab4-5fea78445317","Type":"ContainerDied","Data":"66f63ce6781c3361ada9ffb6bac1283e71de5824fb932241bfc172127c5c2576"}
Jul 07 16:19:05.870274 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:05.870191    2573 scope.go:117] "RemoveContainer" containerID="66f63ce6781c3361ada9ffb6bac1283e71de5824fb932241bfc172127c5c2576"
Jul 07 16:19:05.871557 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:05.871524    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb" event={"ID":"2b113e6c-ecf4-4691-bf5d-7886395a8806","Type":"ContainerStarted","Data":"fd7027e8c286cf15f7dbaa1cdbdef31ef100c476d6d53cfccddb157e81278e61"}
Jul 07 16:19:05.929942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:05.929897    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb" podStartSLOduration=1.293150473 podStartE2EDuration="4.929882143s" totalImagesPullingTime="3.63673167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:05.929227955 +0000 UTC m=+45.780842127" watchObservedRunningTime="2026-07-07 16:19:05.929882143 +0000 UTC m=+45.781496316"
Jul 07 16:19:06.018400 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.018375    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x8wtm"]
Jul 07 16:19:06.034627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.034596    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.036330 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.036305    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8wtm"]
Jul 07 16:19:06.042772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.042754    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmpnl\""
Jul 07 16:19:06.042969 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.042927    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 16:19:06.043128 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.043108    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 16:19:06.043218 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.043139    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 16:19:06.043279 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.043241    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 16:19:06.160068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.160040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.160218 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.160083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0c04353-6371-40d0-823e-d862fe3af16b-crio-socket\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.160218 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.160116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.160309 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.160231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9jz\" (UniqueName: \"kubernetes.io/projected/c0c04353-6371-40d0-823e-d862fe3af16b-kube-api-access-lf9jz\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.160309 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.160268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0c04353-6371-40d0-823e-d862fe3af16b-data-volume\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.261814 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.261595    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9jz\" (UniqueName: \"kubernetes.io/projected/c0c04353-6371-40d0-823e-d862fe3af16b-kube-api-access-lf9jz\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.262020 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.261844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0c04353-6371-40d0-823e-d862fe3af16b-data-volume\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.262020 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.261972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.262141 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.262035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0c04353-6371-40d0-823e-d862fe3af16b-crio-socket\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.262141 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.262076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.262141 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.262122    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.262274 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.262159    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.262274 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.262201    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:06.762163912 +0000 UTC m=+46.613778082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.262274 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.262216    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:06.762209384 +0000 UTC m=+46.613823538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.262438 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.262293    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0c04353-6371-40d0-823e-d862fe3af16b-data-volume\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.262438 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.262293    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0c04353-6371-40d0-823e-d862fe3af16b-crio-socket\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.273160 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.273133    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9jz\" (UniqueName: \"kubernetes.io/projected/c0c04353-6371-40d0-823e-d862fe3af16b-kube-api-access-lf9jz\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.766859 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.766817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.767054 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.766904    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:06.767054 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.767006    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.767179 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.767018    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.767179 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.767088    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:07.767068919 +0000 UTC m=+47.618683090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.767179 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.767144    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:07.767131836 +0000 UTC m=+47.618745987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.875857 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.875828    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/1.log"
Jul 07 16:19:06.876287 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.876273    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/0.log"
Jul 07 16:19:06.876326 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.876306    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b0e5183-067f-46dc-8ab4-5fea78445317" containerID="b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af" exitCode=255
Jul 07 16:19:06.876423 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.876402    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" event={"ID":"2b0e5183-067f-46dc-8ab4-5fea78445317","Type":"ContainerDied","Data":"b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af"}
Jul 07 16:19:06.876477 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.876466    2573 scope.go:117] "RemoveContainer" containerID="66f63ce6781c3361ada9ffb6bac1283e71de5824fb932241bfc172127c5c2576"
Jul 07 16:19:06.876653 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:06.876629    2573 scope.go:117] "RemoveContainer" containerID="b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af"
Jul 07 16:19:06.876841 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:06.876806    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fwtrz_openshift-console-operator(2b0e5183-067f-46dc-8ab4-5fea78445317)\"" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" podUID="2b0e5183-067f-46dc-8ab4-5fea78445317"
Jul 07 16:19:07.775425 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:07.775389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:07.775613 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:07.775456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:07.775613 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:07.775550    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:07.775702 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:07.775617    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:09.775600804 +0000 UTC m=+49.627214954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:07.775702 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:07.775553    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:07.775772 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:07.775702    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:09.775688743 +0000 UTC m=+49.627302898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:07.808112 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:07.808087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cbw7m_ed0eb0c0-a23a-4d82-b558-8efa1860ff9a/dns-node-resolver/0.log"
Jul 07 16:19:07.879744 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:07.879716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/1.log"
Jul 07 16:19:07.880262 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:07.880033    2573 scope.go:117] "RemoveContainer" containerID="b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af"
Jul 07 16:19:07.880262 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:07.880167    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fwtrz_openshift-console-operator(2b0e5183-067f-46dc-8ab4-5fea78445317)\"" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" podUID="2b0e5183-067f-46dc-8ab4-5fea78445317"
Jul 07 16:19:08.800075 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:08.800047    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-khnvq_d41daa32-170a-4b6b-8597-9fcc3e840e25/node-ca/0.log"
Jul 07 16:19:08.885240 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:08.885210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:08.885292    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:08.885379    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:08.885382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:08.885440    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:16.88542154 +0000 UTC m=+56.737035707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : secret "router-metrics-certs-default" not found
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:08.885460    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:16.885449341 +0000 UTC m=+56.737063498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : configmap references non-existent config key: service-ca.crt
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:08.885502    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:08.885511    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9444f6d97-mqkjw: secret "image-registry-tls" not found
Jul 07 16:19:08.885557 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:08.885543    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls podName:cc27c1f1-9630-4691-ab70-b98636aa2b6d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:16.885536035 +0000 UTC m=+56.737150186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls") pod "image-registry-9444f6d97-mqkjw" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d") : secret "image-registry-tls" not found
Jul 07 16:19:09.792172 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:09.792139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:09.792414 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:09.792190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:09.792414 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:09.792260    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:09.792414 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:09.792289    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:09.792414 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:09.792318    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:13.792305695 +0000 UTC m=+53.643919847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:09.792414 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:09.792340    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:13.792327199 +0000 UTC m=+53.643941351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:10.004072 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:10.004044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hsg7w_eea8e3d9-c509-42ed-b99a-30b220afc51f/serve-healthcheck-canary/0.log"
Jul 07 16:19:11.566656 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:11.566621    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:11.567045 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:11.566681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:11.567045 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:11.567028    2573 scope.go:117] "RemoveContainer" containerID="b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af"
Jul 07 16:19:11.567202 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:11.567181    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-fwtrz_openshift-console-operator(2b0e5183-067f-46dc-8ab4-5fea78445317)\"" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" podUID="2b0e5183-067f-46dc-8ab4-5fea78445317"
Jul 07 16:19:12.715118 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:12.715089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:12.715486 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:12.715237    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:12.715486 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:12.715296    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls podName:3bfec422-23c8-4bc5-831d-4f8262019c27 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:28.715281008 +0000 UTC m=+68.566895159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls") pod "dns-default-2rmd6" (UID: "3bfec422-23c8-4bc5-831d-4f8262019c27") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:13.822761 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:13.822724    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:13.823182 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:13.822778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:13.823182 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:13.822838    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:13.823182 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:13.822869    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:13.823182 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:13.822885    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:21.822872607 +0000 UTC m=+61.674486758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:13.823182 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:13.822919    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:21.822906485 +0000 UTC m=+61.674520641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:16.946400 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:16.946363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:16.946457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") pod \"image-registry-9444f6d97-mqkjw\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") " pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:16.946506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:16.946553    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:32.94653043 +0000 UTC m=+72.798144584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : configmap references non-existent config key: service-ca.crt
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:16.946604    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:16.946627    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9444f6d97-mqkjw: secret "image-registry-tls" not found
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:16.946605    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:16.946689    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls podName:cc27c1f1-9630-4691-ab70-b98636aa2b6d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:32.946671739 +0000 UTC m=+72.798285891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls") pod "image-registry-9444f6d97-mqkjw" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d") : secret "image-registry-tls" not found
Jul 07 16:19:16.946830 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:16.946765    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs podName:3fbe5de2-adb7-4c64-917e-224067117816 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:32.946748164 +0000 UTC m=+72.798362319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs") pod "router-default-5bc9946d6c-2zf4h" (UID: "3fbe5de2-adb7-4c64-917e-224067117816") : secret "router-metrics-certs-default" not found
Jul 07 16:19:21.828061 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:21.828033    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm8f"
Jul 07 16:19:21.888259 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:21.888227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:21.888432 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:21.888323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:21.888432 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:21.888423    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:21.888605 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:21.888479    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls podName:c0c04353-6371-40d0-823e-d862fe3af16b nodeName:}" failed. No retries permitted until 2026-07-07 16:19:37.888465271 +0000 UTC m=+77.740079422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x8wtm" (UID: "c0c04353-6371-40d0-823e-d862fe3af16b") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:21.888823 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:21.888802    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0c04353-6371-40d0-823e-d862fe3af16b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:22.653402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.653368    2573 scope.go:117] "RemoveContainer" containerID="b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af"
Jul 07 16:19:22.920386 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.920320    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:19:22.920751 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.920735    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/1.log"
Jul 07 16:19:22.920798 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.920769    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b0e5183-067f-46dc-8ab4-5fea78445317" containerID="65c06be533035589696978aed7b4a5f56bbc2efef114ab9ffb41be21a1a1c1d0" exitCode=255
Jul 07 16:19:22.920831 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.920808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" event={"ID":"2b0e5183-067f-46dc-8ab4-5fea78445317","Type":"ContainerDied","Data":"65c06be533035589696978aed7b4a5f56bbc2efef114ab9ffb41be21a1a1c1d0"}
Jul 07 16:19:22.920864 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.920851    2573 scope.go:117] "RemoveContainer" containerID="b8b5ac01d21f7991edd8f5ff89518741812de8ac1d525e3721495ce82e40a2af"
Jul 07 16:19:22.921131 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:22.921114    2573 scope.go:117] "RemoveContainer" containerID="65c06be533035589696978aed7b4a5f56bbc2efef114ab9ffb41be21a1a1c1d0"
Jul 07 16:19:22.921292 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:22.921273    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-fwtrz_openshift-console-operator(2b0e5183-067f-46dc-8ab4-5fea78445317)\"" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" podUID="2b0e5183-067f-46dc-8ab4-5fea78445317"
Jul 07 16:19:23.924667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:23.924639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:19:26.425074 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.425029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:19:26.427627 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.427608    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:19:26.437684 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.437659    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5e9be16-5f7b-441e-95f9-6a456aaa8cc6-metrics-certs\") pod \"network-metrics-daemon-6gt2n\" (UID: \"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6\") " pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:19:26.471687 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.471663    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nbnd\""
Jul 07 16:19:26.479660 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.479642    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6gt2n"
Jul 07 16:19:26.526291 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.526260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:19:26.526413 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.526325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:19:26.529232 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.528883    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 16:19:26.529232 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.529181    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:19:26.538819 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.538743    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/623fc414-12dd-4832-aa99-074449419721-original-pull-secret\") pod \"global-pull-secret-syncer-xkn26\" (UID: \"623fc414-12dd-4832-aa99-074449419721\") " pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:19:26.538974 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.538938    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 16:19:26.549689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.549668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqklf\" (UniqueName: \"kubernetes.io/projected/69b91335-daa6-45f6-aa44-63a87370204d-kube-api-access-tqklf\") pod \"network-check-target-rk99f\" (UID: \"69b91335-daa6-45f6-aa44-63a87370204d\") " pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:19:26.603494 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.603466    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6gt2n"]
Jul 07 16:19:26.607093 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:26.607070    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e9be16_5f7b_441e_95f9_6a456aaa8cc6.slice/crio-9d7a030c2bbaa783bcc43e6a557bd8023eafe362839fcd2635c37595224a9804 WatchSource:0}: Error finding container 9d7a030c2bbaa783bcc43e6a557bd8023eafe362839fcd2635c37595224a9804: Status 404 returned error can't find the container with id 9d7a030c2bbaa783bcc43e6a557bd8023eafe362839fcd2635c37595224a9804
Jul 07 16:19:26.765480 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.765406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwt\""
Jul 07 16:19:26.773422 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.773393    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xkn26"
Jul 07 16:19:26.774508 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.774461    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:19:26.899774 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.899751    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xkn26"]
Jul 07 16:19:26.901564 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:26.901535    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623fc414_12dd_4832_aa99_074449419721.slice/crio-af23432c0e8eeba4cdab57d42aedd934f496e79145ffd25c8a335da3b909a893 WatchSource:0}: Error finding container af23432c0e8eeba4cdab57d42aedd934f496e79145ffd25c8a335da3b909a893: Status 404 returned error can't find the container with id af23432c0e8eeba4cdab57d42aedd934f496e79145ffd25c8a335da3b909a893
Jul 07 16:19:26.916534 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.916513    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rk99f"]
Jul 07 16:19:26.919059 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:26.919036    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b91335_daa6_45f6_aa44_63a87370204d.slice/crio-2dbc3dc4ee702a7ef57361ab053917160f52cdc5dc3de9927eae51e5cf194a18 WatchSource:0}: Error finding container 2dbc3dc4ee702a7ef57361ab053917160f52cdc5dc3de9927eae51e5cf194a18: Status 404 returned error can't find the container with id 2dbc3dc4ee702a7ef57361ab053917160f52cdc5dc3de9927eae51e5cf194a18
Jul 07 16:19:26.933695 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.933671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rk99f" event={"ID":"69b91335-daa6-45f6-aa44-63a87370204d","Type":"ContainerStarted","Data":"2dbc3dc4ee702a7ef57361ab053917160f52cdc5dc3de9927eae51e5cf194a18"}
Jul 07 16:19:26.934726 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.934703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkn26" event={"ID":"623fc414-12dd-4832-aa99-074449419721","Type":"ContainerStarted","Data":"af23432c0e8eeba4cdab57d42aedd934f496e79145ffd25c8a335da3b909a893"}
Jul 07 16:19:26.935725 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:26.935702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gt2n" event={"ID":"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6","Type":"ContainerStarted","Data":"9d7a030c2bbaa783bcc43e6a557bd8023eafe362839fcd2635c37595224a9804"}
Jul 07 16:19:28.744774 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.744747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:28.749050 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.749023    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bfec422-23c8-4bc5-831d-4f8262019c27-metrics-tls\") pod \"dns-default-2rmd6\" (UID: \"3bfec422-23c8-4bc5-831d-4f8262019c27\") " pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:28.799377 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.799345    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sv27\""
Jul 07 16:19:28.806975 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.806935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:28.942709 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.942677    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gt2n" event={"ID":"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6","Type":"ContainerStarted","Data":"552a948adabf0241fa81289d052bf4bf790480f4531c9427b08dc295fe2537ba"}
Jul 07 16:19:28.942837 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.942735    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6gt2n" event={"ID":"e5e9be16-5f7b-441e-95f9-6a456aaa8cc6","Type":"ContainerStarted","Data":"157042efaa77cd7eddd758e4b5bd128f7279b9209395013c44685eb0d0d049b4"}
Jul 07 16:19:28.946357 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.946333    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rmd6"]
Jul 07 16:19:28.949175 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:28.949152    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfec422_23c8_4bc5_831d_4f8262019c27.slice/crio-102c7725fdc9de7382b1651628918562ff095d67c7c4f1e7eaeb2ed05235f640 WatchSource:0}: Error finding container 102c7725fdc9de7382b1651628918562ff095d67c7c4f1e7eaeb2ed05235f640: Status 404 returned error can't find the container with id 102c7725fdc9de7382b1651628918562ff095d67c7c4f1e7eaeb2ed05235f640
Jul 07 16:19:28.960888 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:28.960835    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6gt2n" podStartSLOduration=66.103714109 podStartE2EDuration="1m7.960814658s" totalImagesPullingTime="1.857100549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:28.960002753 +0000 UTC m=+68.811616930" watchObservedRunningTime="2026-07-07 16:19:28.960814658 +0000 UTC m=+68.812428833"
Jul 07 16:19:29.849891 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.849864    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9444f6d97-mqkjw"]
Jul 07 16:19:29.850284 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:29.850134    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-9444f6d97-mqkjw" podUID="cc27c1f1-9630-4691-ab70-b98636aa2b6d"
Jul 07 16:19:29.885660 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.885629    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54fc4d477b-4cbzr"]
Jul 07 16:19:29.888510 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.888487    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:29.908713 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.908683    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fc4d477b-4cbzr"]
Jul 07 16:19:29.951814 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.951787    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:29.951988 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.951790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rmd6" event={"ID":"3bfec422-23c8-4bc5-831d-4f8262019c27","Type":"ContainerStarted","Data":"102c7725fdc9de7382b1651628918562ff095d67c7c4f1e7eaeb2ed05235f640"}
Jul 07 16:19:29.957997 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:29.957978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:30.055968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.055919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-certificates\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056143 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.055984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-trusted-ca\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056143 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056104    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-bound-sa-token\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056173    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jfts\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-kube-api-access-8jfts\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056200    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-installation-pull-secrets\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056229    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-image-registry-private-configuration\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056411 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056262    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc27c1f1-9630-4691-ab70-b98636aa2b6d-ca-trust-extracted\") pod \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\" (UID: \"cc27c1f1-9630-4691-ab70-b98636aa2b6d\") "
Jul 07 16:19:30.056411 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056351    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04765054-f322-49a3-b1a4-ecbe47af0901-ca-trust-extracted\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056411 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04765054-f322-49a3-b1a4-ecbe47af0901-installation-pull-secrets\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-bound-sa-token\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056468    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04765054-f322-49a3-b1a4-ecbe47af0901-registry-certificates\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04765054-f322-49a3-b1a4-ecbe47af0901-image-registry-private-configuration\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056507    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:19:30.056743 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-registry-tls\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056743 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056577    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:19:30.056743 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl88\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-kube-api-access-jnl88\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056889 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04765054-f322-49a3-b1a4-ecbe47af0901-trusted-ca\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.056889 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.056854    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc27c1f1-9630-4691-ab70-b98636aa2b6d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:30.057072 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.057025    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-certificates\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.057072 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.057052    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc27c1f1-9630-4691-ab70-b98636aa2b6d-trusted-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.058774 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.058751    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:19:30.058910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.058889    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:19:30.058963 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.058909    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-kube-api-access-8jfts" (OuterVolumeSpecName: "kube-api-access-8jfts") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "kube-api-access-8jfts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:19:30.059003 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.058911    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cc27c1f1-9630-4691-ab70-b98636aa2b6d" (UID: "cc27c1f1-9630-4691-ab70-b98636aa2b6d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157481    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04765054-f322-49a3-b1a4-ecbe47af0901-image-registry-private-configuration\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157539    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-registry-tls\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157757    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl88\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-kube-api-access-jnl88\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04765054-f322-49a3-b1a4-ecbe47af0901-trusted-ca\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157846    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04765054-f322-49a3-b1a4-ecbe47af0901-ca-trust-extracted\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04765054-f322-49a3-b1a4-ecbe47af0901-installation-pull-secrets\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-bound-sa-token\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.157977 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.157978    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04765054-f322-49a3-b1a4-ecbe47af0901-registry-certificates\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.158487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158027    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-bound-sa-token\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.158487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158043    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jfts\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-kube-api-access-8jfts\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.158487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158057    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-installation-pull-secrets\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.158487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158077    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc27c1f1-9630-4691-ab70-b98636aa2b6d-image-registry-private-configuration\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.158487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158091    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc27c1f1-9630-4691-ab70-b98636aa2b6d-ca-trust-extracted\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:30.158487 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158430    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04765054-f322-49a3-b1a4-ecbe47af0901-ca-trust-extracted\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.158791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158717    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04765054-f322-49a3-b1a4-ecbe47af0901-trusted-ca\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.158846 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.158813    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04765054-f322-49a3-b1a4-ecbe47af0901-registry-certificates\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.161111 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.161049    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04765054-f322-49a3-b1a4-ecbe47af0901-installation-pull-secrets\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.163354 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.163330    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04765054-f322-49a3-b1a4-ecbe47af0901-image-registry-private-configuration\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.164674 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.164615    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-registry-tls\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.173505 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.173433    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl88\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-kube-api-access-jnl88\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.174089 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.174025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04765054-f322-49a3-b1a4-ecbe47af0901-bound-sa-token\") pod \"image-registry-54fc4d477b-4cbzr\" (UID: \"04765054-f322-49a3-b1a4-ecbe47af0901\") " pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.203806 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.203781    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9zlp\""
Jul 07 16:19:30.211011 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.210987    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:30.955492 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.955406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9444f6d97-mqkjw"
Jul 07 16:19:30.988239 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.988210    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9444f6d97-mqkjw"]
Jul 07 16:19:30.990459 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:30.990433    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9444f6d97-mqkjw"]
Jul 07 16:19:31.065254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:31.065222    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc27c1f1-9630-4691-ab70-b98636aa2b6d-registry-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:19:31.566527 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:31.566488    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:31.566785 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:31.566544    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:31.566915 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:31.566884    2573 scope.go:117] "RemoveContainer" containerID="65c06be533035589696978aed7b4a5f56bbc2efef114ab9ffb41be21a1a1c1d0"
Jul 07 16:19:31.567103 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:31.567082    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-fwtrz_openshift-console-operator(2b0e5183-067f-46dc-8ab4-5fea78445317)\"" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" podUID="2b0e5183-067f-46dc-8ab4-5fea78445317"
Jul 07 16:19:32.657343 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:32.657303    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc27c1f1-9630-4691-ab70-b98636aa2b6d" path="/var/lib/kubelet/pods/cc27c1f1-9630-4691-ab70-b98636aa2b6d/volumes"
Jul 07 16:19:32.983357 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:32.983274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:32.983528 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:32.983377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:32.984060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:32.984030    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fbe5de2-adb7-4c64-917e-224067117816-service-ca-bundle\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:32.986354 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:32.986331    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3fbe5de2-adb7-4c64-917e-224067117816-metrics-certs\") pod \"router-default-5bc9946d6c-2zf4h\" (UID: \"3fbe5de2-adb7-4c64-917e-224067117816\") " pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:33.196242 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.196219    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9zxs8\""
Jul 07 16:19:33.204839 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.204730    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:33.218036 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.217921    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fc4d477b-4cbzr"]
Jul 07 16:19:33.224677 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:33.224629    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04765054_f322_49a3_b1a4_ecbe47af0901.slice/crio-0c3d8f008253dd8e52e541d2a86009d9997f7db7608ea388350d6b59abcd9ba8 WatchSource:0}: Error finding container 0c3d8f008253dd8e52e541d2a86009d9997f7db7608ea388350d6b59abcd9ba8: Status 404 returned error can't find the container with id 0c3d8f008253dd8e52e541d2a86009d9997f7db7608ea388350d6b59abcd9ba8
Jul 07 16:19:33.393824 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.393637    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bc9946d6c-2zf4h"]
Jul 07 16:19:33.397400 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:33.397372    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbe5de2_adb7_4c64_917e_224067117816.slice/crio-7aaf63ce55d640ebea3dd9a4e7a22e654b61f949c3fb8882ae8336517ccf7f98 WatchSource:0}: Error finding container 7aaf63ce55d640ebea3dd9a4e7a22e654b61f949c3fb8882ae8336517ccf7f98: Status 404 returned error can't find the container with id 7aaf63ce55d640ebea3dd9a4e7a22e654b61f949c3fb8882ae8336517ccf7f98
Jul 07 16:19:33.974032 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.973999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rmd6" event={"ID":"3bfec422-23c8-4bc5-831d-4f8262019c27","Type":"ContainerStarted","Data":"3a1a140e42beebd63a1f62777041468a3ab6e15674a3e5225278963b612b16ae"}
Jul 07 16:19:33.974447 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.974050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rmd6" event={"ID":"3bfec422-23c8-4bc5-831d-4f8262019c27","Type":"ContainerStarted","Data":"119769e29fcc99f511ad3e6de7a906842b4b4577a6e1a5bbcf5f9a7cfa859018"}
Jul 07 16:19:33.974447 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.974107    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:33.975516 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.975486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr" event={"ID":"04765054-f322-49a3-b1a4-ecbe47af0901","Type":"ContainerStarted","Data":"ce58be9a8bdb3ff9f82b9bf22a446701358f948abad001b4d7216586511a508a"}
Jul 07 16:19:33.975643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.975539    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:33.975643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.975554    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr" event={"ID":"04765054-f322-49a3-b1a4-ecbe47af0901","Type":"ContainerStarted","Data":"0c3d8f008253dd8e52e541d2a86009d9997f7db7608ea388350d6b59abcd9ba8"}
Jul 07 16:19:33.976904 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.976878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rk99f" event={"ID":"69b91335-daa6-45f6-aa44-63a87370204d","Type":"ContainerStarted","Data":"e5a0fc1b890abdc1a1393060c3b08552f48f18cd9263549202a5ec68731209cc"}
Jul 07 16:19:33.977028 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.976973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:19:33.978250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.978230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h" event={"ID":"3fbe5de2-adb7-4c64-917e-224067117816","Type":"ContainerStarted","Data":"9e0753d2e8944f17312502f3cbbac3aa6e73d198aab067f404ee96492b55cbb5"}
Jul 07 16:19:33.978354 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.978262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h" event={"ID":"3fbe5de2-adb7-4c64-917e-224067117816","Type":"ContainerStarted","Data":"7aaf63ce55d640ebea3dd9a4e7a22e654b61f949c3fb8882ae8336517ccf7f98"}
Jul 07 16:19:33.979582 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:33.979560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xkn26" event={"ID":"623fc414-12dd-4832-aa99-074449419721","Type":"ContainerStarted","Data":"1bc9c4d4afd06950b3ccd416ba3529f1b204955b3c025c50f164240b0ad856c8"}
Jul 07 16:19:34.000588 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.000542    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2rmd6" podStartSLOduration=33.871352381 podStartE2EDuration="38.000527796s" totalImagesPullingTime="4.129175415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:34.000513076 +0000 UTC m=+73.852127278" watchObservedRunningTime="2026-07-07 16:19:34.000527796 +0000 UTC m=+73.852142009"
Jul 07 16:19:34.036927 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.036883    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr" podStartSLOduration=5.036869975 podStartE2EDuration="5.036869975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:34.036527804 +0000 UTC m=+73.888141976" watchObservedRunningTime="2026-07-07 16:19:34.036869975 +0000 UTC m=+73.888484147"
Jul 07 16:19:34.108512 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.108468    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xkn26" podStartSLOduration=66.919178336 podStartE2EDuration="1m13.108455183s" totalImagesPullingTime="6.189276847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:34.079764473 +0000 UTC m=+73.931378647" watchObservedRunningTime="2026-07-07 16:19:34.108455183 +0000 UTC m=+73.960069356"
Jul 07 16:19:34.153343 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.153302    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rk99f" podStartSLOduration=66.995925655 podStartE2EDuration="1m13.153293123s" totalImagesPullingTime="6.157367468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:34.108151506 +0000 UTC m=+73.959765679" watchObservedRunningTime="2026-07-07 16:19:34.153293123 +0000 UTC m=+74.004907296"
Jul 07 16:19:34.153860 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.153839    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h" podStartSLOduration=33.153832284 podStartE2EDuration="33.153832284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:34.153118669 +0000 UTC m=+74.004732847" watchObservedRunningTime="2026-07-07 16:19:34.153832284 +0000 UTC m=+74.005446457"
Jul 07 16:19:34.205558 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.205528    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:34.207928 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.207906    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:34.983198 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.983173    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:34.984464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:34.984443    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bc9946d6c-2zf4h"
Jul 07 16:19:36.616193 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.616156    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"]
Jul 07 16:19:36.662984 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.662939    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"]
Jul 07 16:19:36.663130 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.663051    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:36.665618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.665594    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-g5rtx\""
Jul 07 16:19:36.665779 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.665758    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 16:19:36.709486 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.709451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/50954389-061b-4107-a802-9109922377e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xt2jb\" (UID: \"50954389-061b-4107-a802-9109922377e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:36.810261 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:36.810233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/50954389-061b-4107-a802-9109922377e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xt2jb\" (UID: \"50954389-061b-4107-a802-9109922377e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:36.810374 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:36.810346    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 07 16:19:36.810421 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:36.810402    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50954389-061b-4107-a802-9109922377e9-tls-certificates podName:50954389-061b-4107-a802-9109922377e9 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:37.310384313 +0000 UTC m=+77.161998467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/50954389-061b-4107-a802-9109922377e9-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-xt2jb" (UID: "50954389-061b-4107-a802-9109922377e9") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 07 16:19:37.315103 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.315061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/50954389-061b-4107-a802-9109922377e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xt2jb\" (UID: \"50954389-061b-4107-a802-9109922377e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:37.317406 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.317374    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/50954389-061b-4107-a802-9109922377e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xt2jb\" (UID: \"50954389-061b-4107-a802-9109922377e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:37.572212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.572131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:37.691217 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.691196    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"]
Jul 07 16:19:37.693608 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:37.693581    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50954389_061b_4107_a802_9109922377e9.slice/crio-3be71b78a73ea60abb1353bb01f9ab3fe84dcbe6ea9999b8e4c37321801d8085 WatchSource:0}: Error finding container 3be71b78a73ea60abb1353bb01f9ab3fe84dcbe6ea9999b8e4c37321801d8085: Status 404 returned error can't find the container with id 3be71b78a73ea60abb1353bb01f9ab3fe84dcbe6ea9999b8e4c37321801d8085
Jul 07 16:19:37.919745 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.919718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:37.921963 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.921931    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0c04353-6371-40d0-823e-d862fe3af16b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x8wtm\" (UID: \"c0c04353-6371-40d0-823e-d862fe3af16b\") " pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:37.993604 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:37.993572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb" event={"ID":"50954389-061b-4107-a802-9109922377e9","Type":"ContainerStarted","Data":"3be71b78a73ea60abb1353bb01f9ab3fe84dcbe6ea9999b8e4c37321801d8085"}
Jul 07 16:19:38.206224 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:38.206158    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmpnl\""
Jul 07 16:19:38.213888 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:38.213864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x8wtm"
Jul 07 16:19:38.368968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:38.368915    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x8wtm"]
Jul 07 16:19:38.371719 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:38.371694    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c04353_6371_40d0_823e_d862fe3af16b.slice/crio-7fbbf7ab8b8baea248b66d55320a7d4c960ae9feb2b12b5c8b6bd75134a5bd0c WatchSource:0}: Error finding container 7fbbf7ab8b8baea248b66d55320a7d4c960ae9feb2b12b5c8b6bd75134a5bd0c: Status 404 returned error can't find the container with id 7fbbf7ab8b8baea248b66d55320a7d4c960ae9feb2b12b5c8b6bd75134a5bd0c
Jul 07 16:19:39.001683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.000987    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb" event={"ID":"50954389-061b-4107-a802-9109922377e9","Type":"ContainerStarted","Data":"08eb09b30e73d8b6fd1e726e687be48069a31bca95058a80a9d45d350d7afb74"}
Jul 07 16:19:39.001683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.001509    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:39.003457 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.003413    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8wtm" event={"ID":"c0c04353-6371-40d0-823e-d862fe3af16b","Type":"ContainerStarted","Data":"7fbbf7ab8b8baea248b66d55320a7d4c960ae9feb2b12b5c8b6bd75134a5bd0c"}
Jul 07 16:19:39.007620 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.007588    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb"
Jul 07 16:19:39.020237 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.020008    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xt2jb" podStartSLOduration=1.918885442 podStartE2EDuration="3.019993661s" totalImagesPullingTime="1.101108219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:39.019111906 +0000 UTC m=+78.870726081" watchObservedRunningTime="2026-07-07 16:19:39.019993661 +0000 UTC m=+78.871607833"
Jul 07 16:19:39.687092 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.687048    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"]
Jul 07 16:19:39.690048 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.690016    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.692390 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.692369    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jv7hp\""
Jul 07 16:19:39.692739 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.692704    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 16:19:39.693494 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.693476    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 16:19:39.693645 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.693548    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 16:19:39.693645 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.693597    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 16:19:39.693766 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.693688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 16:19:39.704796 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.704771    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"]
Jul 07 16:19:39.734127 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.734095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wz7n\" (UniqueName: \"kubernetes.io/projected/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-kube-api-access-7wz7n\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.734266 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.734144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.734266 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.734225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.734380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.734301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.835785 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.835746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.835963 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.835798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.835963 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.835832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.835963 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.835884    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wz7n\" (UniqueName: \"kubernetes.io/projected/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-kube-api-access-7wz7n\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.836648 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.836618    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.838526 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.838501    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.838762 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.838735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:39.844523 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:39.844500    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wz7n\" (UniqueName: \"kubernetes.io/projected/d4f8f2a1-5c97-4203-ad25-e9bd27728a07-kube-api-access-7wz7n\") pod \"prometheus-operator-567f7b8b7c-tzhjp\" (UID: \"d4f8f2a1-5c97-4203-ad25-e9bd27728a07\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:40.005857 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:40.005731    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"
Jul 07 16:19:42.139549 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:42.139525    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp"]
Jul 07 16:19:42.142536 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:42.142511    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f8f2a1_5c97_4203_ad25_e9bd27728a07.slice/crio-6fa3a3a6e7f01f19148df2e152618f0f3e8a3cf6bbc7e50b7f179086df28922a WatchSource:0}: Error finding container 6fa3a3a6e7f01f19148df2e152618f0f3e8a3cf6bbc7e50b7f179086df28922a: Status 404 returned error can't find the container with id 6fa3a3a6e7f01f19148df2e152618f0f3e8a3cf6bbc7e50b7f179086df28922a
Jul 07 16:19:43.017353 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:43.017277    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp" event={"ID":"d4f8f2a1-5c97-4203-ad25-e9bd27728a07","Type":"ContainerStarted","Data":"6fa3a3a6e7f01f19148df2e152618f0f3e8a3cf6bbc7e50b7f179086df28922a"}
Jul 07 16:19:43.018832 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:43.018801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8wtm" event={"ID":"c0c04353-6371-40d0-823e-d862fe3af16b","Type":"ContainerStarted","Data":"f9ad6e23390337a7d8976f8a4d76e1b36c2623b27f5fbc011a43caef6e9a7eb3"}
Jul 07 16:19:43.018982 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:43.018851    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8wtm" event={"ID":"c0c04353-6371-40d0-823e-d862fe3af16b","Type":"ContainerStarted","Data":"4ca44d5f262ece8c176b6549704510246d7468ccd5cf5ee1c2d39c785f518dcc"}
Jul 07 16:19:43.986061 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:43.986027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2rmd6"
Jul 07 16:19:45.030493 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:45.030459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp" event={"ID":"d4f8f2a1-5c97-4203-ad25-e9bd27728a07","Type":"ContainerStarted","Data":"7e296477fb1f6bac8dc1df76d5afc70e8a4393596c786fa179b94ad90030a609"}
Jul 07 16:19:45.030906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:45.030518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp" event={"ID":"d4f8f2a1-5c97-4203-ad25-e9bd27728a07","Type":"ContainerStarted","Data":"7f9371d363127414a81394f9dfd28d967213323c4a9d992f9bdde4b42cc3119a"}
Jul 07 16:19:45.050822 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:45.050764    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tzhjp" podStartSLOduration=4.198324776 podStartE2EDuration="6.050743979s" totalImagesPullingTime="1.852419203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:45.04824264 +0000 UTC m=+84.899856814" watchObservedRunningTime="2026-07-07 16:19:45.050743979 +0000 UTC m=+84.902358154"
Jul 07 16:19:45.653673 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:45.653643    2573 scope.go:117] "RemoveContainer" containerID="65c06be533035589696978aed7b4a5f56bbc2efef114ab9ffb41be21a1a1c1d0"
Jul 07 16:19:46.038600 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.038529    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:19:46.038986 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.038616    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" event={"ID":"2b0e5183-067f-46dc-8ab4-5fea78445317","Type":"ContainerStarted","Data":"f2ca3b71b7ddc29f5b38e72ca0dcecb361cb587a08f4b0663bc5c41cdda72572"}
Jul 07 16:19:46.038986 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.038905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:46.041140 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.041115    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x8wtm" event={"ID":"c0c04353-6371-40d0-823e-d862fe3af16b","Type":"ContainerStarted","Data":"c8b6d700eb5c8896413ad290c471ea241ec82514836ba7e4122d3d81cd3a59b7"}
Jul 07 16:19:46.057107 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.057070    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz" podStartSLOduration=41.593273886 podStartE2EDuration="45.057057554s" totalImagesPullingTime="3.463783668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:46.055617038 +0000 UTC m=+85.907231225" watchObservedRunningTime="2026-07-07 16:19:46.057057554 +0000 UTC m=+85.908671760"
Jul 07 16:19:46.078213 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.078171    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x8wtm" podStartSLOduration=34.134443549 podStartE2EDuration="41.078158332s" totalImagesPullingTime="6.943714783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:19:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:46.077109736 +0000 UTC m=+85.928723909" watchObservedRunningTime="2026-07-07 16:19:46.078158332 +0000 UTC m=+85.929772505"
Jul 07 16:19:46.476466 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:46.476437    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-fwtrz"
Jul 07 16:19:47.297505 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.297476    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-49t2d"]
Jul 07 16:19:47.300737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.300719    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.308289 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.308269    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 16:19:47.309226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.309208    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wvwn\""
Jul 07 16:19:47.309284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.309208    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 16:19:47.309443 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.309431    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 16:19:47.376137 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.376113    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"]
Jul 07 16:19:47.379382 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.379364    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.382679 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.382660    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 16:19:47.382777 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.382703    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lqwv7\""
Jul 07 16:19:47.382895 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.382878    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 16:19:47.383000 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.382984    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 16:19:47.394225 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.394203    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"]
Jul 07 16:19:47.400882 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.400860    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-sys\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401004 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.400891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401004 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.400914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401004 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.400977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-wtmp\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.401011    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-tls\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.401054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-root\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.401074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-textfile\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.401101    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-metrics-client-ca\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.401178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.401133    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxnxg\" (UniqueName: \"kubernetes.io/projected/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-kube-api-access-fxnxg\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501429 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b9711d8-5cd1-44db-9168-0fd7370228a3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501470    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501497    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-sys\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501553 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-wtmp\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-tls\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-root\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-textfile\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501673    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-sys\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501685    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-wtmp\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501692    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-root\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-metrics-client-ca\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:47.501736    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnxg\" (UniqueName: \"kubernetes.io/projected/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-kube-api-access-fxnxg\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:19:47.501799    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-tls podName:ffd6e1af-b723-4fc4-a127-8fef95bff8f6 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:48.001780235 +0000 UTC m=+87.853394393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-tls") pod "node-exporter-49t2d" (UID: "ffd6e1af-b723-4fc4-a127-8fef95bff8f6") : secret "node-exporter-tls" not found
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b9711d8-5cd1-44db-9168-0fd7370228a3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.501910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.501865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdzvs\" (UniqueName: \"kubernetes.io/projected/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-api-access-hdzvs\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.502341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.502019    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-textfile\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.502341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.502171    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.502341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.502205    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-metrics-client-ca\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.503981 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.503942    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.514184 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.514166    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxnxg\" (UniqueName: \"kubernetes.io/projected/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-kube-api-access-fxnxg\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:47.602268 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b9711d8-5cd1-44db-9168-0fd7370228a3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.602268 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdzvs\" (UniqueName: \"kubernetes.io/projected/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-api-access-hdzvs\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.602268 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.602520 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b9711d8-5cd1-44db-9168-0fd7370228a3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.602520 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602377    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.602520 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602412    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.602665 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.602602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b9711d8-5cd1-44db-9168-0fd7370228a3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.603046 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.603023    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b9711d8-5cd1-44db-9168-0fd7370228a3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.603163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.603113    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.604728 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.604701    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.604985 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.604937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.611010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.610985    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdzvs\" (UniqueName: \"kubernetes.io/projected/1b9711d8-5cd1-44db-9168-0fd7370228a3-kube-api-access-hdzvs\") pod \"kube-state-metrics-7c9dbb8b7d-rrdjj\" (UID: \"1b9711d8-5cd1-44db-9168-0fd7370228a3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.688062 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.688031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"
Jul 07 16:19:47.820535 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:47.820506    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj"]
Jul 07 16:19:47.822736 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:47.822711    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9711d8_5cd1_44db_9168_0fd7370228a3.slice/crio-0ddfb21f97818d45c60f68802ca734685f346ba3f8ec53878ffd66f556afaa46 WatchSource:0}: Error finding container 0ddfb21f97818d45c60f68802ca734685f346ba3f8ec53878ffd66f556afaa46: Status 404 returned error can't find the container with id 0ddfb21f97818d45c60f68802ca734685f346ba3f8ec53878ffd66f556afaa46
Jul 07 16:19:48.006771 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.006740    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-tls\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:48.008908 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.008889    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd6e1af-b723-4fc4-a127-8fef95bff8f6-node-exporter-tls\") pod \"node-exporter-49t2d\" (UID: \"ffd6e1af-b723-4fc4-a127-8fef95bff8f6\") " pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:48.050419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.050384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj" event={"ID":"1b9711d8-5cd1-44db-9168-0fd7370228a3","Type":"ContainerStarted","Data":"0ddfb21f97818d45c60f68802ca734685f346ba3f8ec53878ffd66f556afaa46"}
Jul 07 16:19:48.195889 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.195855    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:19:48.200896 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.200874    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.203386 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.203365    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 16:19:48.205254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.203731    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6j9k2\""
Jul 07 16:19:48.205254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.204320    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 16:19:48.205254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.204573    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 16:19:48.205254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.204757    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 16:19:48.205254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.204938    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 16:19:48.205254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.205145    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 16:19:48.205618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.205387    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 16:19:48.205618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.205387    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 16:19:48.205618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.205444    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 16:19:48.210093 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.210075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49t2d"
Jul 07 16:19:48.220505 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.220486    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:19:48.221936 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:48.221911    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd6e1af_b723_4fc4_a127_8fef95bff8f6.slice/crio-5d06ab76c3ceac59b5318be7d77067232254e88b7a4869948294168323fe6400 WatchSource:0}: Error finding container 5d06ab76c3ceac59b5318be7d77067232254e88b7a4869948294168323fe6400: Status 404 returned error can't find the container with id 5d06ab76c3ceac59b5318be7d77067232254e88b7a4869948294168323fe6400
Jul 07 16:19:48.308621 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.308621 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.308621 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-web-config\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-out\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knv2m\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-kube-api-access-knv2m\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.309068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.308893    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.409898 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.409868    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.409898 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.409897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410137 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.409921    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410137 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.409993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410137 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410042    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410137 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410327 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410187    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410327 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-web-config\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410327 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-out\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knv2m\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-kube-api-access-knv2m\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.410775 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.410750    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.412432 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.412401    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.413171 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.413146    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-volume\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.413280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.413257    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.413566 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.413540    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.413707 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.413686    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-web-config\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.413916 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.413891    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-out\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.413916 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.413905    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.414083 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.414060    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.414591 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.414573    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.414662 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.414613    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.418828 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.418810    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knv2m\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-kube-api-access-knv2m\") pod \"alertmanager-main-0\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.511155 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.511127    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:19:48.647940 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:48.647918    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:19:48.650030 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:48.649998    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0992d1d_be1a_4c3d_9a1f_3bf4de56692f.slice/crio-64e63706499b100e373e367890f17d2cf66bb1b567e9603e3a0d0e5e536a1b8b WatchSource:0}: Error finding container 64e63706499b100e373e367890f17d2cf66bb1b567e9603e3a0d0e5e536a1b8b: Status 404 returned error can't find the container with id 64e63706499b100e373e367890f17d2cf66bb1b567e9603e3a0d0e5e536a1b8b
Jul 07 16:19:49.056872 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:49.056834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"64e63706499b100e373e367890f17d2cf66bb1b567e9603e3a0d0e5e536a1b8b"}
Jul 07 16:19:49.058290 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:49.058258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49t2d" event={"ID":"ffd6e1af-b723-4fc4-a127-8fef95bff8f6","Type":"ContainerStarted","Data":"5d06ab76c3ceac59b5318be7d77067232254e88b7a4869948294168323fe6400"}
Jul 07 16:19:50.072351 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:50.072318    2573 generic.go:356] "Generic (PLEG): container finished" podID="ffd6e1af-b723-4fc4-a127-8fef95bff8f6" containerID="b3c868535d73f92390955e919f5dc603f93da385bbb7be17524f8b3da4067380" exitCode=0
Jul 07 16:19:50.072686 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:50.072415    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49t2d" event={"ID":"ffd6e1af-b723-4fc4-a127-8fef95bff8f6","Type":"ContainerDied","Data":"b3c868535d73f92390955e919f5dc603f93da385bbb7be17524f8b3da4067380"}
Jul 07 16:19:51.077899 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.077809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj" event={"ID":"1b9711d8-5cd1-44db-9168-0fd7370228a3","Type":"ContainerStarted","Data":"38f080a88f9230409d6f48513f1760233508d0917c894f9d1783723db1249389"}
Jul 07 16:19:51.077899 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.077880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj" event={"ID":"1b9711d8-5cd1-44db-9168-0fd7370228a3","Type":"ContainerStarted","Data":"8b344dd84184f9d319fb186ff74bd899a74d64bac41ee6b6693f90fc70feef81"}
Jul 07 16:19:51.078326 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.077908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj" event={"ID":"1b9711d8-5cd1-44db-9168-0fd7370228a3","Type":"ContainerStarted","Data":"984cd9be96972813d7fa7684fb5cb91587965ce5c510c0af1f279a529c02fd5c"}
Jul 07 16:19:51.079815 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.079786    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49t2d" event={"ID":"ffd6e1af-b723-4fc4-a127-8fef95bff8f6","Type":"ContainerStarted","Data":"5539c36e02dad8be2055597b221f19e4356ea375dfe8af389110f46b2e7e5150"}
Jul 07 16:19:51.079970 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.079839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49t2d" event={"ID":"ffd6e1af-b723-4fc4-a127-8fef95bff8f6","Type":"ContainerStarted","Data":"8eb3255a23c3002f8ad260b892ade55c4e172187e9b3276ac828d3c054b5bf2d"}
Jul 07 16:19:51.081212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.081188    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad" exitCode=0
Jul 07 16:19:51.081292 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.081229    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad"}
Jul 07 16:19:51.102670 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.102626    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-rrdjj" podStartSLOduration=1.886911251 podStartE2EDuration="4.102612174s" totalImagesPullingTime="2.215700923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:51.101926582 +0000 UTC m=+90.953540756" watchObservedRunningTime="2026-07-07 16:19:51.102612174 +0000 UTC m=+90.954226346"
Jul 07 16:19:51.125424 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.125386    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-49t2d" podStartSLOduration=2.949711943 podStartE2EDuration="4.125372341s" totalImagesPullingTime="1.104815182s" totalInitContainerRuntime="70.845216ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:51.12457731 +0000 UTC m=+90.976191482" watchObservedRunningTime="2026-07-07 16:19:51.125372341 +0000 UTC m=+90.976986514"
Jul 07 16:19:51.767146 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.767105    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-668bb7d545-74rcs"]
Jul 07 16:19:51.771019 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.770986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.775038 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.775011    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 16:19:51.775038 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.775035    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 16:19:51.775233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.775018    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 16:19:51.775538 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.775515    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hzggs\""
Jul 07 16:19:51.776433 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.776258    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dqmj8tcgoche2\""
Jul 07 16:19:51.776433 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.776352    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 16:19:51.783247 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.783225    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-668bb7d545-74rcs"]
Jul 07 16:19:51.842306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842044    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjmvw\" (UniqueName: \"kubernetes.io/projected/8cde5855-ea82-4039-8c8d-773b11450e17-kube-api-access-tjmvw\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.842306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-secret-metrics-server-tls\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.842306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cde5855-ea82-4039-8c8d-773b11450e17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.842306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-client-ca-bundle\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.842306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-secret-metrics-server-client-certs\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.842306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8cde5855-ea82-4039-8c8d-773b11450e17-metrics-server-audit-profiles\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.842736 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.842348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8cde5855-ea82-4039-8c8d-773b11450e17-audit-log\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943357 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjmvw\" (UniqueName: \"kubernetes.io/projected/8cde5855-ea82-4039-8c8d-773b11450e17-kube-api-access-tjmvw\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-secret-metrics-server-tls\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cde5855-ea82-4039-8c8d-773b11450e17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943438    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-client-ca-bundle\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-secret-metrics-server-client-certs\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8cde5855-ea82-4039-8c8d-773b11450e17-metrics-server-audit-profiles\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.943773 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.943551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8cde5855-ea82-4039-8c8d-773b11450e17-audit-log\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.944066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.944039    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8cde5855-ea82-4039-8c8d-773b11450e17-audit-log\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.944604 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.944579    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cde5855-ea82-4039-8c8d-773b11450e17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.944873 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.944851    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8cde5855-ea82-4039-8c8d-773b11450e17-metrics-server-audit-profiles\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.946232 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.946207    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-client-ca-bundle\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.946434 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.946414    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-secret-metrics-server-client-certs\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.946502 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.946418    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8cde5855-ea82-4039-8c8d-773b11450e17-secret-metrics-server-tls\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:51.953654 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:51.953632    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjmvw\" (UniqueName: \"kubernetes.io/projected/8cde5855-ea82-4039-8c8d-773b11450e17-kube-api-access-tjmvw\") pod \"metrics-server-668bb7d545-74rcs\" (UID: \"8cde5855-ea82-4039-8c8d-773b11450e17\") " pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:52.082695 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:52.082619    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:19:52.230087 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:52.230058    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-668bb7d545-74rcs"]
Jul 07 16:19:52.231812 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:52.231789    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cde5855_ea82_4039_8c8d_773b11450e17.slice/crio-ee81df0b174eaac25c4ece0abb9af827f402ae516f944c325694729601d6d976 WatchSource:0}: Error finding container ee81df0b174eaac25c4ece0abb9af827f402ae516f944c325694729601d6d976: Status 404 returned error can't find the container with id ee81df0b174eaac25c4ece0abb9af827f402ae516f944c325694729601d6d976
Jul 07 16:19:53.092829 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.092794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs" event={"ID":"8cde5855-ea82-4039-8c8d-773b11450e17","Type":"ContainerStarted","Data":"ee81df0b174eaac25c4ece0abb9af827f402ae516f944c325694729601d6d976"}
Jul 07 16:19:53.508471 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.506325    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:19:53.512370 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.512346    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.521407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.520837    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 16:19:53.521407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.520854    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 16:19:53.521407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.520854    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 16:19:53.521407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.521104    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 16:19:53.521407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.521249    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 16:19:53.521863 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.521820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 16:19:53.522084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.522061    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 16:19:53.522274 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.522252    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 16:19:53.522486 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.522359    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 16:19:53.522486 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.522366    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 16:19:53.522666 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.522649    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h4ccc\""
Jul 07 16:19:53.530998 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.529870    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 16:19:53.530998 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.530190    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 16:19:53.530998 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.530420    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 16:19:53.530998 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.530924    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fv539hqdb42hl\""
Jul 07 16:19:53.534830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.534505    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 16:19:53.548008 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.542081    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:19:53.660212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660182    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-config\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660251    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660329    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n42rg\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-kube-api-access-n42rg\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660598    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.660805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.661139 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.660811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763327 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763284    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763496 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763496 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763496 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763496 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763505    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763532    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763561    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-config\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763635    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.763714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763682    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763781    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763888    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.763913    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n42rg\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-kube-api-access-n42rg\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.764523 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.764219    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.765156 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.764807    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.765156 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.764848    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.766173 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.765472    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.766840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.766399    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.766840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.766527    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.766840 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.766559    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.767072 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.766996    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.767123 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.767090    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.767222 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.767195    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.767978 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.767642    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.767978 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.767664    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.767978 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.767922    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.768966 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.768923    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.769165 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.769146    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.769465 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.769445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.769549 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.769534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-config\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.769732 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.769710    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.770852 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.770808    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.773122 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.773100    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n42rg\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-kube-api-access-n42rg\") pod \"prometheus-k8s-0\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:53.838596 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:53.838561    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:19:54.014817 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.014762    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:19:54.101514 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.101476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8"}
Jul 07 16:19:54.101901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.101557    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc"}
Jul 07 16:19:54.101901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.101600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366"}
Jul 07 16:19:54.101901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.101641    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04"}
Jul 07 16:19:54.101901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.101680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b"}
Jul 07 16:19:54.375816 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:19:54.375742    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3adc9d_22d5_46b2_b622_872da742415a.slice/crio-1e305b03d57466fa70575983155f7637ded3872982266f61082e6abbc66bfb87 WatchSource:0}: Error finding container 1e305b03d57466fa70575983155f7637ded3872982266f61082e6abbc66bfb87: Status 404 returned error can't find the container with id 1e305b03d57466fa70575983155f7637ded3872982266f61082e6abbc66bfb87
Jul 07 16:19:54.988542 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:54.988518    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54fc4d477b-4cbzr"
Jul 07 16:19:55.109121 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.109041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerStarted","Data":"4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f"}
Jul 07 16:19:55.110601 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.110575    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578" exitCode=0
Jul 07 16:19:55.110734 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.110665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578"}
Jul 07 16:19:55.110782 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.110734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"1e305b03d57466fa70575983155f7637ded3872982266f61082e6abbc66bfb87"}
Jul 07 16:19:55.112073 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.112048    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs" event={"ID":"8cde5855-ea82-4039-8c8d-773b11450e17","Type":"ContainerStarted","Data":"22a7648b4d487dcf6e3a0f73011dd5b22bed6a401c7b9db3fc3f6bdda13b19c0"}
Jul 07 16:19:55.141449 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.141394    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.410099907 podStartE2EDuration="7.141376184s" totalImagesPullingTime="4.708842256s" totalInitContainerRuntime="22.434021ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:55.13912534 +0000 UTC m=+94.990739549" watchObservedRunningTime="2026-07-07 16:19:55.141376184 +0000 UTC m=+94.992990358"
Jul 07 16:19:55.198375 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:19:55.198317    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs" podStartSLOduration=1.976199769 podStartE2EDuration="4.198302424s" totalImagesPullingTime="2.222102655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:55.197293808 +0000 UTC m=+95.048907982" watchObservedRunningTime="2026-07-07 16:19:55.198302424 +0000 UTC m=+95.049916597"
Jul 07 16:20:00.138574 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:00.138538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084"}
Jul 07 16:20:00.139026 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:00.138614    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416"}
Jul 07 16:20:02.153827 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:02.153789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333"}
Jul 07 16:20:02.154310 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:02.153882    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053"}
Jul 07 16:20:02.154310 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:02.153908    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9"}
Jul 07 16:20:02.154310 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:02.153945    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerStarted","Data":"0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44"}
Jul 07 16:20:02.187698 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:02.187646    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.280770386 podStartE2EDuration="9.187624649s" totalImagesPullingTime="5.886329044s" totalInitContainerRuntime="20.525219ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:20:02.184886055 +0000 UTC m=+102.036500246" watchObservedRunningTime="2026-07-07 16:20:02.187624649 +0000 UTC m=+102.039238824"
Jul 07 16:20:03.839289 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:03.839255    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:20:04.985388 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:04.985353    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rk99f"
Jul 07 16:20:12.083439 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:12.083408    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:20:12.083813 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:12.083458    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:20:27.248242 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:27.248207    2573 generic.go:356] "Generic (PLEG): container finished" podID="2b113e6c-ecf4-4691-bf5d-7886395a8806" containerID="fd7027e8c286cf15f7dbaa1cdbdef31ef100c476d6d53cfccddb157e81278e61" exitCode=0
Jul 07 16:20:27.248658 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:27.248279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb" event={"ID":"2b113e6c-ecf4-4691-bf5d-7886395a8806","Type":"ContainerDied","Data":"fd7027e8c286cf15f7dbaa1cdbdef31ef100c476d6d53cfccddb157e81278e61"}
Jul 07 16:20:27.248658 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:27.248585    2573 scope.go:117] "RemoveContainer" containerID="fd7027e8c286cf15f7dbaa1cdbdef31ef100c476d6d53cfccddb157e81278e61"
Jul 07 16:20:28.253524 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:28.253489    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-l8kcb" event={"ID":"2b113e6c-ecf4-4691-bf5d-7886395a8806","Type":"ContainerStarted","Data":"5978c714034af9207531a187ba30a036eb671fbba655494d747671f08873d021"}
Jul 07 16:20:32.087604 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:32.087575    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:20:32.091399 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:32.091376    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-668bb7d545-74rcs"
Jul 07 16:20:53.839568 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:53.839535    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:20:53.854889 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:53.854868    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:20:54.371106 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:20:54.371083    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:07.546860 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.546820    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:21:07.547380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.547176    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="alertmanager" containerID="cri-o://4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b" gracePeriod=120
Jul 07 16:21:07.547380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.547242    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-metric" containerID="cri-o://5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8" gracePeriod=120
Jul 07 16:21:07.547380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.547299    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy" containerID="cri-o://044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc" gracePeriod=120
Jul 07 16:21:07.547380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.547330    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="prom-label-proxy" containerID="cri-o://4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f" gracePeriod=120
Jul 07 16:21:07.547380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.547254    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-web" containerID="cri-o://aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366" gracePeriod=120
Jul 07 16:21:07.547603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:07.547263    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="config-reloader" containerID="cri-o://124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04" gracePeriod=120
Jul 07 16:21:08.416968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.416917    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f" exitCode=0
Jul 07 16:21:08.416968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.416943    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8" exitCode=0
Jul 07 16:21:08.416968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.416972    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc" exitCode=0
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.416981    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04" exitCode=0
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.416988    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b" exitCode=0
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.416998    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f"}
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.417062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8"}
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.417087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc"}
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.417111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04"}
Jul 07 16:21:08.417214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.417134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b"}
Jul 07 16:21:08.793714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.793692    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:08.920252 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920221    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-main-tls\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-metrics-client-ca\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920285    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-out\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920303    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-tls-assets\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920332    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920353    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-web\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920372    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knv2m\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-kube-api-access-knv2m\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920463    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920509    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-cluster-tls-config\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920542    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-volume\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920570    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-web-config\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920599    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-main-db\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920629    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-trusted-ca-bundle\") pod \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\" (UID: \"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f\") "
Jul 07 16:21:08.920748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920663    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:08.921144 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.920909    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-metrics-client-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:08.921421 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.921351    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:08.921608 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.921579    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:08.923061 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.923032    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:21:08.923279 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.923252    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:08.923499 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.923476    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:08.924158 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.924119    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:08.924247 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.924149    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-volume" (OuterVolumeSpecName: "config-volume") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:08.924311 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.924256    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-out" (OuterVolumeSpecName: "config-out") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:08.924562 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.924540    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:08.924931 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.924901    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-kube-api-access-knv2m" (OuterVolumeSpecName: "kube-api-access-knv2m") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "kube-api-access-knv2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:21:08.927838 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.927815    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:08.933943 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:08.933920    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-web-config" (OuterVolumeSpecName: "web-config") pod "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" (UID: "d0992d1d-be1a-4c3d-9a1f-3bf4de56692f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022170    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-cluster-tls-config\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022193    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-volume\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022204    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-web-config\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022213    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-main-db\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022222    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022231    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-main-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022240    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-config-out\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022247    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-tls-assets\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022255    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022265    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022274    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knv2m\" (UniqueName: \"kubernetes.io/projected/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-kube-api-access-knv2m\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.022603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.022282    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:09.424114 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.424079    2573 generic.go:356] "Generic (PLEG): container finished" podID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerID="aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366" exitCode=0
Jul 07 16:21:09.424275 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.424148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366"}
Jul 07 16:21:09.424275 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.424177    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.424275 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.424223    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d0992d1d-be1a-4c3d-9a1f-3bf4de56692f","Type":"ContainerDied","Data":"64e63706499b100e373e367890f17d2cf66bb1b567e9603e3a0d0e5e536a1b8b"}
Jul 07 16:21:09.424275 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.424271    2573 scope.go:117] "RemoveContainer" containerID="4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f"
Jul 07 16:21:09.432932 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.432913    2573 scope.go:117] "RemoveContainer" containerID="5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8"
Jul 07 16:21:09.439673 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.439651    2573 scope.go:117] "RemoveContainer" containerID="044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc"
Jul 07 16:21:09.446022 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.446007    2573 scope.go:117] "RemoveContainer" containerID="aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366"
Jul 07 16:21:09.449801 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.449776    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:21:09.454178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.454160    2573 scope.go:117] "RemoveContainer" containerID="124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04"
Jul 07 16:21:09.454603 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.454584    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:21:09.460648 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.460633    2573 scope.go:117] "RemoveContainer" containerID="4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b"
Jul 07 16:21:09.467233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.467216    2573 scope.go:117] "RemoveContainer" containerID="e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad"
Jul 07 16:21:09.473712 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.473695    2573 scope.go:117] "RemoveContainer" containerID="4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f"
Jul 07 16:21:09.474210 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.474138    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f\": container with ID starting with 4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f not found: ID does not exist" containerID="4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f"
Jul 07 16:21:09.474327 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.474182    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f"} err="failed to get container status \"4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f\": rpc error: code = NotFound desc = could not find container \"4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f\": container with ID starting with 4d507c2d53a97360e4cdda53864968bc4a92bec7579039706a7ff354b2dccb1f not found: ID does not exist"
Jul 07 16:21:09.474327 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.474226    2573 scope.go:117] "RemoveContainer" containerID="5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8"
Jul 07 16:21:09.474539 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.474511    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8\": container with ID starting with 5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8 not found: ID does not exist" containerID="5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8"
Jul 07 16:21:09.474640 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.474546    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8"} err="failed to get container status \"5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8\": rpc error: code = NotFound desc = could not find container \"5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8\": container with ID starting with 5c922e1d74afe9c304a3d321949efa7aa9d65779c7be7744b6d909325b8a0ba8 not found: ID does not exist"
Jul 07 16:21:09.474640 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.474568    2573 scope.go:117] "RemoveContainer" containerID="044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc"
Jul 07 16:21:09.474935 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.474917    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc\": container with ID starting with 044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc not found: ID does not exist" containerID="044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc"
Jul 07 16:21:09.475015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.474939    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc"} err="failed to get container status \"044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc\": rpc error: code = NotFound desc = could not find container \"044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc\": container with ID starting with 044abb4df84e74c864154ce05475d2c7ffbba7ff04de7a28b9a3d3e14318c0dc not found: ID does not exist"
Jul 07 16:21:09.475015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.474990    2573 scope.go:117] "RemoveContainer" containerID="aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366"
Jul 07 16:21:09.475241 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.475223    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366\": container with ID starting with aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366 not found: ID does not exist" containerID="aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366"
Jul 07 16:21:09.475305 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.475249    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366"} err="failed to get container status \"aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366\": rpc error: code = NotFound desc = could not find container \"aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366\": container with ID starting with aabee4815ce5ea0f64d5b8dc8413eb9e6cb4ab9578f98bb607cbd21687460366 not found: ID does not exist"
Jul 07 16:21:09.475305 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.475271    2573 scope.go:117] "RemoveContainer" containerID="124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04"
Jul 07 16:21:09.475544 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.475517    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04\": container with ID starting with 124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04 not found: ID does not exist" containerID="124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04"
Jul 07 16:21:09.475588 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.475542    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04"} err="failed to get container status \"124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04\": rpc error: code = NotFound desc = could not find container \"124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04\": container with ID starting with 124d4badf869b285454736a308d37857ca62470e5e82a5068f8cf36753a3fe04 not found: ID does not exist"
Jul 07 16:21:09.475588 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.475562    2573 scope.go:117] "RemoveContainer" containerID="4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b"
Jul 07 16:21:09.475799 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.475778    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b\": container with ID starting with 4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b not found: ID does not exist" containerID="4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b"
Jul 07 16:21:09.475880 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.475804    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b"} err="failed to get container status \"4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b\": rpc error: code = NotFound desc = could not find container \"4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b\": container with ID starting with 4cba1bd86afa65d1d13a4828a1e170bca2763474e67b4fe4929a58de09ccc66b not found: ID does not exist"
Jul 07 16:21:09.475880 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.475819    2573 scope.go:117] "RemoveContainer" containerID="e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad"
Jul 07 16:21:09.476103 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:09.476082    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad\": container with ID starting with e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad not found: ID does not exist" containerID="e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad"
Jul 07 16:21:09.476153 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.476112    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad"} err="failed to get container status \"e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad\": rpc error: code = NotFound desc = could not find container \"e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad\": container with ID starting with e600c914e5d60df22d4263182ce50793236c32286e0ab1f39b8f62d6348885ad not found: ID does not exist"
Jul 07 16:21:09.483909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.483887    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:21:09.484205 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484190    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="config-reloader"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484207    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="config-reloader"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484218    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484223    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484233    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="init-config-reloader"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484238    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="init-config-reloader"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484245    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-web"
Jul 07 16:21:09.484254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484250    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-web"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484259    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="prom-label-proxy"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484264    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="prom-label-proxy"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484270    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="alertmanager"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484275    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="alertmanager"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484280    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-metric"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484285    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-metric"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484333    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="config-reloader"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484341    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-metric"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484346    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="alertmanager"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484351    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="prom-label-proxy"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484357    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy"
Jul 07 16:21:09.484455 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.484362    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" containerName="kube-rbac-proxy-web"
Jul 07 16:21:09.489257 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.489232    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.491818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.491780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 16:21:09.491818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.491798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 16:21:09.491818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.491809    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 16:21:09.492067 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.491879    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 16:21:09.492067 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.491797    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 16:21:09.492067 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.491881    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 16:21:09.492220 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.492152    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6j9k2\""
Jul 07 16:21:09.492220 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.492204    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 16:21:09.492434 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.492418    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 16:21:09.496781 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.496762    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 16:21:09.504145 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.504124    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:21:09.527336 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527301    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527451 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527451 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2829e0c6-962b-43e8-9032-6d739040469d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-web-config\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5t2\" (UniqueName: \"kubernetes.io/projected/2829e0c6-962b-43e8-9032-6d739040469d-kube-api-access-wx5t2\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527519    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2829e0c6-962b-43e8-9032-6d739040469d-config-out\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527709 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2829e0c6-962b-43e8-9032-6d739040469d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527709 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-config-volume\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527709 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2829e0c6-962b-43e8-9032-6d739040469d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2829e0c6-962b-43e8-9032-6d739040469d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.527818 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.527759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629122 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-web-config\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629127    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629145    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5t2\" (UniqueName: \"kubernetes.io/projected/2829e0c6-962b-43e8-9032-6d739040469d-kube-api-access-wx5t2\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629165    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2829e0c6-962b-43e8-9032-6d739040469d-config-out\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2829e0c6-962b-43e8-9032-6d739040469d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629208    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-config-volume\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2829e0c6-962b-43e8-9032-6d739040469d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629625 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629305    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2829e0c6-962b-43e8-9032-6d739040469d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629625 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629625 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629625 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.629625 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.629428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2829e0c6-962b-43e8-9032-6d739040469d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.630280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.630158    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2829e0c6-962b-43e8-9032-6d739040469d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.630838 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.630484    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2829e0c6-962b-43e8-9032-6d739040469d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.632846 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.630981    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2829e0c6-962b-43e8-9032-6d739040469d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.632846 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.632108    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.635938 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.633198    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.635938 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.634282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-web-config\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.637803 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.637752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-config-volume\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.637906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.637828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5t2\" (UniqueName: \"kubernetes.io/projected/2829e0c6-962b-43e8-9032-6d739040469d-kube-api-access-wx5t2\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.638179 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.638079    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2829e0c6-962b-43e8-9032-6d739040469d-config-out\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.638315 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.638290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.638839 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.638814    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.638930 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.638842    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2829e0c6-962b-43e8-9032-6d739040469d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.639494 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.639473    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2829e0c6-962b-43e8-9032-6d739040469d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2829e0c6-962b-43e8-9032-6d739040469d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.799344 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.799280    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 16:21:09.931984 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:09.931940    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 16:21:09.933970 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:21:09.933929    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2829e0c6_962b_43e8_9032_6d739040469d.slice/crio-635c6d47c1460f60498611b61e31fb10d7eaaf5da1b26dd45dd9650a717fdea4 WatchSource:0}: Error finding container 635c6d47c1460f60498611b61e31fb10d7eaaf5da1b26dd45dd9650a717fdea4: Status 404 returned error can't find the container with id 635c6d47c1460f60498611b61e31fb10d7eaaf5da1b26dd45dd9650a717fdea4
Jul 07 16:21:10.429726 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:10.429688    2573 generic.go:356] "Generic (PLEG): container finished" podID="2829e0c6-962b-43e8-9032-6d739040469d" containerID="b56856f40a5632c80eb6ccdb096516e8a955d4c9069836aed6d385ee93562833" exitCode=0
Jul 07 16:21:10.429917 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:10.429784    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerDied","Data":"b56856f40a5632c80eb6ccdb096516e8a955d4c9069836aed6d385ee93562833"}
Jul 07 16:21:10.429917 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:10.429869    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"635c6d47c1460f60498611b61e31fb10d7eaaf5da1b26dd45dd9650a717fdea4"}
Jul 07 16:21:10.660594 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:10.660568    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0992d1d-be1a-4c3d-9a1f-3bf4de56692f" path="/var/lib/kubelet/pods/d0992d1d-be1a-4c3d-9a1f-3bf4de56692f/volumes"
Jul 07 16:21:11.439491 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.439457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"b6ef99eb1ec36d29be185f9f7a5c131e04c76208db2964dfd62acba4eba14ae3"}
Jul 07 16:21:11.439942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.439536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"fcbd8ddc84b79a091e530fab648ff68abaadb5385d5ecdeab48ce17a83b83e72"}
Jul 07 16:21:11.439942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.439578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"e85507577a66542f2650b17c4fca0264f279e04c8bd0d33bff5ed89391942ae4"}
Jul 07 16:21:11.439942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.439613    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"fef3cfaf90a09785ba14f060a84cfd50dac23da9b699bfe703f0002ebc43c58f"}
Jul 07 16:21:11.439942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.439648    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"65bb49e752640bf63d39da436a858cfbe5109c8e06281346fa600e1efb8376ea"}
Jul 07 16:21:11.439942 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.439688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2829e0c6-962b-43e8-9032-6d739040469d","Type":"ContainerStarted","Data":"20a71bed5cad829a593dbb14f024054b42b6b8dca5249d793c4ff07a24a6c48b"}
Jul 07 16:21:11.466257 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.466199    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.451680931 podStartE2EDuration="2.466182846s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.501915ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:21:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:21:11.465882027 +0000 UTC m=+171.317496238" watchObservedRunningTime="2026-07-07 16:21:11.466182846 +0000 UTC m=+171.317797019"
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.925828    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.926414    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="prometheus" containerID="cri-o://3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416" gracePeriod=600
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.926654    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="thanos-sidecar" containerID="cri-o://0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44" gracePeriod=600
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.926651    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy" containerID="cri-o://704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053" gracePeriod=600
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.926766    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333" gracePeriod=600
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.926823    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-web" containerID="cri-o://4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9" gracePeriod=600
Jul 07 16:21:11.926906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:11.926858    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="config-reloader" containerID="cri-o://533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084" gracePeriod=600
Jul 07 16:21:12.446563 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446533    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333" exitCode=0
Jul 07 16:21:12.446563 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446558    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053" exitCode=0
Jul 07 16:21:12.446563 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446569    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44" exitCode=0
Jul 07 16:21:12.446563 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446578    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084" exitCode=0
Jul 07 16:21:12.447185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446586    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416" exitCode=0
Jul 07 16:21:12.447185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446603    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333"}
Jul 07 16:21:12.447185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053"}
Jul 07 16:21:12.447185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446695    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44"}
Jul 07 16:21:12.447185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446720    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084"}
Jul 07 16:21:12.447185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:12.446742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416"}
Jul 07 16:21:13.176687 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.176666    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.262238 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262169    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-config\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262238 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262259    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-tls-assets\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-config-out\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262402    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-metrics-client-ca\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262607 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-thanos-prometheus-http-client-file\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262607 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262487    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-1\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262607 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-web-config\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262607 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262553    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-grpc-tls\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262607 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262589    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262620    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-db\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262643    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-trusted-ca-bundle\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262670    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-tls\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262697    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-kube-rbac-proxy\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262758    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-kubelet-serving-ca-bundle\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262783    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262798    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-0\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.262842 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262824    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-serving-certs-ca-bundle\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.263244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262850    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-2\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.263244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262857    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.263244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262882    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-metrics-client-certs\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.263244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.262919    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n42rg\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-kube-api-access-n42rg\") pod \"1c3adc9d-22d5-46b2-b622-872da742415a\" (UID: \"1c3adc9d-22d5-46b2-b622-872da742415a\") "
Jul 07 16:21:13.263244 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.263243    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-metrics-client-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.263482 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.263262    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.264841 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.264035    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:13.264841 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.264508    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.265077 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.264918    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.265077 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.264935    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.265573 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.265503    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-config" (OuterVolumeSpecName: "config") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.265680 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.265565    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.265853 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.265828    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:21:13.266393 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.266372    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-kube-api-access-n42rg" (OuterVolumeSpecName: "kube-api-access-n42rg") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "kube-api-access-n42rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:21:13.266486 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.266401    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.266922 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.266886    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.267424 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.267399    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:21:13.267512 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.267474    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-config-out" (OuterVolumeSpecName: "config-out") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:13.267713 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.267685    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.267821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.267797    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.267988 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.267936    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.268501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.268478    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.268701 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.268681    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.278400 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.278376    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-web-config" (OuterVolumeSpecName: "web-config") pod "1c3adc9d-22d5-46b2-b622-872da742415a" (UID: "1c3adc9d-22d5-46b2-b622-872da742415a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:13.363861 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363831    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n42rg\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-kube-api-access-n42rg\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.363861 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363855    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-config\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.363861 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363865    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363875    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c3adc9d-22d5-46b2-b622-872da742415a-tls-assets\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363884    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-config-out\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363892    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363900    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-web-config\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363908    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-grpc-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363916    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363925    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-db\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363933    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363942    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363975    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-kube-rbac-proxy\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.363990    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.364003    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.364014    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.364023    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c3adc9d-22d5-46b2-b622-872da742415a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.364066 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.364032    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c3adc9d-22d5-46b2-b622-872da742415a-secret-metrics-client-certs\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:21:13.453689 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.453662    2573 generic.go:356] "Generic (PLEG): container finished" podID="1c3adc9d-22d5-46b2-b622-872da742415a" containerID="4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9" exitCode=0
Jul 07 16:21:13.454060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.453696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9"}
Jul 07 16:21:13.454060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.453739    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.454060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.453750    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c3adc9d-22d5-46b2-b622-872da742415a","Type":"ContainerDied","Data":"1e305b03d57466fa70575983155f7637ded3872982266f61082e6abbc66bfb87"}
Jul 07 16:21:13.454060 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.453784    2573 scope.go:117] "RemoveContainer" containerID="4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333"
Jul 07 16:21:13.462555 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.462529    2573 scope.go:117] "RemoveContainer" containerID="704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053"
Jul 07 16:21:13.469692 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.469676    2573 scope.go:117] "RemoveContainer" containerID="4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9"
Jul 07 16:21:13.475880 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.475863    2573 scope.go:117] "RemoveContainer" containerID="0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44"
Jul 07 16:21:13.478923 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.478904    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:21:13.483590 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.483571    2573 scope.go:117] "RemoveContainer" containerID="533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084"
Jul 07 16:21:13.484179 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.484158    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:21:13.490106 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.490091    2573 scope.go:117] "RemoveContainer" containerID="3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416"
Jul 07 16:21:13.497119 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.497101    2573 scope.go:117] "RemoveContainer" containerID="1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578"
Jul 07 16:21:13.503665 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.503648    2573 scope.go:117] "RemoveContainer" containerID="4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333"
Jul 07 16:21:13.503910 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.503894    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333\": container with ID starting with 4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333 not found: ID does not exist" containerID="4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333"
Jul 07 16:21:13.503983 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.503917    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333"} err="failed to get container status \"4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333\": rpc error: code = NotFound desc = could not find container \"4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333\": container with ID starting with 4208a38294d590e8bf1e0f55d26241fa7457eef2c106870dabf03f4284fa0333 not found: ID does not exist"
Jul 07 16:21:13.503983 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.503933    2573 scope.go:117] "RemoveContainer" containerID="704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053"
Jul 07 16:21:13.504161 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.504141    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053\": container with ID starting with 704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053 not found: ID does not exist" containerID="704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053"
Jul 07 16:21:13.504199 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504167    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053"} err="failed to get container status \"704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053\": rpc error: code = NotFound desc = could not find container \"704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053\": container with ID starting with 704ac658094bf20deac933e74a23055ef4cc642ae489ea27f7100c05ca8ad053 not found: ID does not exist"
Jul 07 16:21:13.504199 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504181    2573 scope.go:117] "RemoveContainer" containerID="4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9"
Jul 07 16:21:13.504354 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.504340    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9\": container with ID starting with 4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9 not found: ID does not exist" containerID="4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9"
Jul 07 16:21:13.504393 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504355    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9"} err="failed to get container status \"4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9\": rpc error: code = NotFound desc = could not find container \"4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9\": container with ID starting with 4b3116be854e43221add26fd1dde95475539946bff2dfd855f311a3f47d45da9 not found: ID does not exist"
Jul 07 16:21:13.504393 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504368    2573 scope.go:117] "RemoveContainer" containerID="0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44"
Jul 07 16:21:13.504572 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.504558    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44\": container with ID starting with 0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44 not found: ID does not exist" containerID="0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44"
Jul 07 16:21:13.504611 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504576    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44"} err="failed to get container status \"0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44\": rpc error: code = NotFound desc = could not find container \"0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44\": container with ID starting with 0c813f15c31b36060dbc88aae5133aa4c7d96d283a48706904d99eab0ad55b44 not found: ID does not exist"
Jul 07 16:21:13.504611 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504587    2573 scope.go:117] "RemoveContainer" containerID="533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084"
Jul 07 16:21:13.504772 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.504756    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084\": container with ID starting with 533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084 not found: ID does not exist" containerID="533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084"
Jul 07 16:21:13.504809 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504774    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084"} err="failed to get container status \"533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084\": rpc error: code = NotFound desc = could not find container \"533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084\": container with ID starting with 533cc53e82683d4f0d2f4101871b221e371f4e3b5b95a50e5d535fb6641ca084 not found: ID does not exist"
Jul 07 16:21:13.504809 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504786    2573 scope.go:117] "RemoveContainer" containerID="3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416"
Jul 07 16:21:13.504983 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.504942    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416\": container with ID starting with 3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416 not found: ID does not exist" containerID="3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416"
Jul 07 16:21:13.505100 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504984    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416"} err="failed to get container status \"3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416\": rpc error: code = NotFound desc = could not find container \"3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416\": container with ID starting with 3c7e2930b793c3cb06ee8eb0c7bb7f5c5489a5efb528dc1f5198d3393a411416 not found: ID does not exist"
Jul 07 16:21:13.505100 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.504995    2573 scope.go:117] "RemoveContainer" containerID="1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578"
Jul 07 16:21:13.505240 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:21:13.505211    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578\": container with ID starting with 1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578 not found: ID does not exist" containerID="1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578"
Jul 07 16:21:13.505282 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.505243    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578"} err="failed to get container status \"1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578\": rpc error: code = NotFound desc = could not find container \"1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578\": container with ID starting with 1989e83307602ae6181043148beb5a85d0aa98afc4c453268c13aef8196dc578 not found: ID does not exist"
Jul 07 16:21:13.512814 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.512794    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:21:13.513092 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513080    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="prometheus"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513094    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="prometheus"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513107    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-thanos"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513113    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-thanos"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513121    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="config-reloader"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513126    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="config-reloader"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513134    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="init-config-reloader"
Jul 07 16:21:13.513142 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513140    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="init-config-reloader"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513148    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-web"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513153    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-web"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513162    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="thanos-sidecar"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513167    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="thanos-sidecar"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513174    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513178    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513239    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="thanos-sidecar"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513249    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="prometheus"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513256    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-web"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513262    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513268    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="config-reloader"
Jul 07 16:21:13.513350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.513273    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" containerName="kube-rbac-proxy-thanos"
Jul 07 16:21:13.520342 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.520297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.522715 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.522684    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 16:21:13.522813 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.522714    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 16:21:13.522935 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.522916    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 16:21:13.523030 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.522920    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fv539hqdb42hl\""
Jul 07 16:21:13.523030 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.522986    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 16:21:13.523208 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523188    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 16:21:13.523512 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523498    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 16:21:13.523570 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523529    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 16:21:13.523844 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523787    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 16:21:13.523844 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523813    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 16:21:13.523844 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523814    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h4ccc\""
Jul 07 16:21:13.524037 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.523814    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 16:21:13.524233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.524216    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 16:21:13.524299 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.524283    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 16:21:13.527325 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.527304    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 16:21:13.530114 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.530093    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 16:21:13.538334 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.538310    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:21:13.565450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.565584 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.565584 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.565584 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-config\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.565584 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e41fc638-a991-4623-b48a-aadb42af27e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.565826 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565606    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.565826 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.565660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566077 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566102    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566315 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566315 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566315 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e41fc638-a991-4623-b48a-aadb42af27e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566401 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566503 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566503 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566439    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.566503 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.566457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf8ch\" (UniqueName: \"kubernetes.io/projected/e41fc638-a991-4623-b48a-aadb42af27e1-kube-api-access-sf8ch\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-config\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e41fc638-a991-4623-b48a-aadb42af27e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667966    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.667998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668089    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e41fc638-a991-4623-b48a-aadb42af27e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668271    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668303    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.668336    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf8ch\" (UniqueName: \"kubernetes.io/projected/e41fc638-a991-4623-b48a-aadb42af27e1-kube-api-access-sf8ch\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.671668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.672933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.672836    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.673195 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.673095    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675143 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675115    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675691 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675419    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675691 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675428    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675823 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675788    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675887 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675827    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e41fc638-a991-4623-b48a-aadb42af27e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675887 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675840    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.675887 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.675868    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676086 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e41fc638-a991-4623-b48a-aadb42af27e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676086 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676062    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676190    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676526 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676466    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-config\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676562    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676607    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.676872 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.676853    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.678125 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.678106    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf8ch\" (UniqueName: \"kubernetes.io/projected/e41fc638-a991-4623-b48a-aadb42af27e1-kube-api-access-sf8ch\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.678349 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.678334    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e41fc638-a991-4623-b48a-aadb42af27e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.679298 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.679281    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e41fc638-a991-4623-b48a-aadb42af27e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e41fc638-a991-4623-b48a-aadb42af27e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.830801 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.830744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:21:13.966991 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:13.966968    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 16:21:13.968843 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:21:13.968818    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41fc638_a991_4623_b48a_aadb42af27e1.slice/crio-6ac1a1f2522135f48fc6682be3276d83d8fb111183252203ee89560b2d45c17f WatchSource:0}: Error finding container 6ac1a1f2522135f48fc6682be3276d83d8fb111183252203ee89560b2d45c17f: Status 404 returned error can't find the container with id 6ac1a1f2522135f48fc6682be3276d83d8fb111183252203ee89560b2d45c17f
Jul 07 16:21:14.461847 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:14.461812    2573 generic.go:356] "Generic (PLEG): container finished" podID="e41fc638-a991-4623-b48a-aadb42af27e1" containerID="96567de7c97040e5e78a974d50e5175902a59902b0cbb9408df5bee0b41eff46" exitCode=0
Jul 07 16:21:14.462250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:14.461857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerDied","Data":"96567de7c97040e5e78a974d50e5175902a59902b0cbb9408df5bee0b41eff46"}
Jul 07 16:21:14.462250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:14.461906    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"6ac1a1f2522135f48fc6682be3276d83d8fb111183252203ee89560b2d45c17f"}
Jul 07 16:21:14.663030 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:14.661395    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3adc9d-22d5-46b2-b622-872da742415a" path="/var/lib/kubelet/pods/1c3adc9d-22d5-46b2-b622-872da742415a/volumes"
Jul 07 16:21:15.468795 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.468761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"a8e3163899648793138d25e7b809a59d1e6fa9d745a809e046b4dc5e997dd6a7"}
Jul 07 16:21:15.469180 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.468837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"15d6246174b93a1cdb8c2c800f6c8e171a9bafab7e47eeb49ce80916d783361e"}
Jul 07 16:21:15.469180 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.468868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"eaa316906af0ecda2907e4db5482ce655ace834d00ba65c8e0244ed4cf4f185f"}
Jul 07 16:21:15.469180 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.468893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"e0b4cdf41576af3d1886c7cc6bbd6ed3732e67cebeff6054d84b8c4c2b714520"}
Jul 07 16:21:15.469180 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.468918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"722d075ee9af6ff2a28dcbfd0d282e1eaf01131b0e9de68a638e701aae877bda"}
Jul 07 16:21:15.469180 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.468942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e41fc638-a991-4623-b48a-aadb42af27e1","Type":"ContainerStarted","Data":"570493182a6d30c92cf36fcde0d4972b2fc876ac816e6d7c11b09d299395a1a9"}
Jul 07 16:21:15.502803 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:15.502747    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.481212055 podStartE2EDuration="2.502728101s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.516046ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:21:15.500707578 +0000 UTC m=+175.352321752" watchObservedRunningTime="2026-07-07 16:21:15.502728101 +0000 UTC m=+175.354342275"
Jul 07 16:21:18.831451 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:21:18.831424    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:22:13.831810 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:22:13.831772    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:22:13.847065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:22:13.847043    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:22:14.702731 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:22:14.702706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 16:23:20.572073 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:23:20.572042    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:23:20.576367 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:23:20.576345    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:23:20.582480 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:23:20.582456    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 16:23:20.583307 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:23:20.583285    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:23:20.587530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:23:20.587506    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:24:39.620042 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.619960    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"]
Jul 07 16:24:39.623511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.623490    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.626672 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.626644    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 16:24:39.627003 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.626981    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 16:24:39.627130 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.627016    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 16:24:39.627130 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.627107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gg9gr\""
Jul 07 16:24:39.627273 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.627260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 16:24:39.641096 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.641075    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"]
Jul 07 16:24:39.786463 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.786428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qzp\" (UniqueName: \"kubernetes.io/projected/ed8a6902-f025-40ea-94b7-ab141dad306a-kube-api-access-f6qzp\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.786633 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.786493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed8a6902-f025-40ea-94b7-ab141dad306a-tmp\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.786633 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.786535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed8a6902-f025-40ea-94b7-ab141dad306a-manifests\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.786633 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.786586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed8a6902-f025-40ea-94b7-ab141dad306a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.786633 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.786603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed8a6902-f025-40ea-94b7-ab141dad306a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.887502 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.887480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed8a6902-f025-40ea-94b7-ab141dad306a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.887671 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.887513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed8a6902-f025-40ea-94b7-ab141dad306a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.887671 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.887537    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qzp\" (UniqueName: \"kubernetes.io/projected/ed8a6902-f025-40ea-94b7-ab141dad306a-kube-api-access-f6qzp\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.887671 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.887570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed8a6902-f025-40ea-94b7-ab141dad306a-tmp\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.887671 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.887592    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed8a6902-f025-40ea-94b7-ab141dad306a-manifests\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.888068 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.888041    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed8a6902-f025-40ea-94b7-ab141dad306a-manifests\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.889763 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.889743    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed8a6902-f025-40ea-94b7-ab141dad306a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.889862 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.889744    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed8a6902-f025-40ea-94b7-ab141dad306a-tmp\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.889979 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.889961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed8a6902-f025-40ea-94b7-ab141dad306a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.898593 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.898571    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qzp\" (UniqueName: \"kubernetes.io/projected/ed8a6902-f025-40ea-94b7-ab141dad306a-kube-api-access-f6qzp\") pod \"opendatahub-operator-controller-manager-6f64778974-vgt4j\" (UID: \"ed8a6902-f025-40ea-94b7-ab141dad306a\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:39.934587 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:39.934568    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:40.068535 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:40.068506    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"]
Jul 07 16:24:40.071152 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:24:40.071126    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8a6902_f025_40ea_94b7_ab141dad306a.slice/crio-009e72cdfb1e5ff61af8afffab850e424180efa2f9c05e80986bd2e755bb6694 WatchSource:0}: Error finding container 009e72cdfb1e5ff61af8afffab850e424180efa2f9c05e80986bd2e755bb6694: Status 404 returned error can't find the container with id 009e72cdfb1e5ff61af8afffab850e424180efa2f9c05e80986bd2e755bb6694
Jul 07 16:24:40.072869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:40.072851    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:24:40.243311 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:40.243230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j" event={"ID":"ed8a6902-f025-40ea-94b7-ab141dad306a","Type":"ContainerStarted","Data":"009e72cdfb1e5ff61af8afffab850e424180efa2f9c05e80986bd2e755bb6694"}
Jul 07 16:24:44.263472 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:44.263436    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j" event={"ID":"ed8a6902-f025-40ea-94b7-ab141dad306a","Type":"ContainerStarted","Data":"c46cae7b5ae80472d80511fa683fb204628a620db7596f7c2d286213b37e79b7"}
Jul 07 16:24:45.268796 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:45.268760    2573 generic.go:356] "Generic (PLEG): container finished" podID="ed8a6902-f025-40ea-94b7-ab141dad306a" containerID="c46cae7b5ae80472d80511fa683fb204628a620db7596f7c2d286213b37e79b7" exitCode=0
Jul 07 16:24:45.269330 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:45.268850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j" event={"ID":"ed8a6902-f025-40ea-94b7-ab141dad306a","Type":"ContainerDied","Data":"c46cae7b5ae80472d80511fa683fb204628a620db7596f7c2d286213b37e79b7"}
Jul 07 16:24:46.275330 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:46.275292    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j" event={"ID":"ed8a6902-f025-40ea-94b7-ab141dad306a","Type":"ContainerStarted","Data":"6ae02dc725677fd24e675505adecba24b034cf588f0b6947ae99b8975a3ef781"}
Jul 07 16:24:46.275720 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:46.275408    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:24:46.299530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:46.299476    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j" podStartSLOduration=2.676220494 podStartE2EDuration="7.299461591s" totalImagesPullingTime="3.607157046s" totalInitContainerRuntime="1.016084051s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:46.297156263 +0000 UTC m=+386.148770436" watchObservedRunningTime="2026-07-07 16:24:46.299461591 +0000 UTC m=+386.151075763"
Jul 07 16:24:57.282593 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:24:57.282557    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-vgt4j"
Jul 07 16:25:01.183437 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.183394    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"]
Jul 07 16:25:01.196148 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.196108    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.200052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.200030    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mnzlh\""
Jul 07 16:25:01.200276 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.200262    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 16:25:01.200801 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.200782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 16:25:01.201128 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.201114    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 16:25:01.212874 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.212853    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 16:25:01.235374 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.235346    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"]
Jul 07 16:25:01.278685 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.278685 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-token\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.278877 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-cacerts\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.278877 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsp82\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-kube-api-access-jsp82\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.278877 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-local-certs\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.279016 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.279016 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.278906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.379912 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.379880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.379912 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.379917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-token\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.380188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.379945    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-cacerts\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.380188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.379998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsp82\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-kube-api-access-jsp82\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.380188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.380046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-local-certs\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.380188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.380070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.380188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.380104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.380821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.380795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.382355 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.382329    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-local-certs\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.382618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.382593    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.383074 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.383058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.383128 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.383093    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-cacerts\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.394380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.390025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsp82\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-kube-api-access-jsp82\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.394380 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.390120    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-token\") pod \"istiod-openshift-gateway-7574459656-mshxp\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.505024 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.504906    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:01.644120 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:01.644095    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"]
Jul 07 16:25:01.646526 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:25:01.646495    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c88e71d_f468_42f4_99bc_6fbed3d7fdfc.slice/crio-f69088d8be2d6bc968c9edab2b9d609a7b55f95cbf3e170e6141c867fa0fe6b2 WatchSource:0}: Error finding container f69088d8be2d6bc968c9edab2b9d609a7b55f95cbf3e170e6141c867fa0fe6b2: Status 404 returned error can't find the container with id f69088d8be2d6bc968c9edab2b9d609a7b55f95cbf3e170e6141c867fa0fe6b2
Jul 07 16:25:02.347889 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:02.347850    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" event={"ID":"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc","Type":"ContainerStarted","Data":"f69088d8be2d6bc968c9edab2b9d609a7b55f95cbf3e170e6141c867fa0fe6b2"}
Jul 07 16:25:04.450268 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:04.450224    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:25:04.450534 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:04.450304    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:25:05.366325 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:05.366285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" event={"ID":"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc","Type":"ContainerStarted","Data":"a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142"}
Jul 07 16:25:05.366516 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:05.366471    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:05.368110 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:05.368078    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mshxp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 16:25:05.368224 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:05.368137    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 16:25:06.370867 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:06.370837    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:06.392968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:06.392896    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" podStartSLOduration=2.5915350950000002 podStartE2EDuration="5.392879084s" totalImagesPullingTime="2.801343989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:05.395867412 +0000 UTC m=+405.247481588" watchObservedRunningTime="2026-07-07 16:25:06.392879084 +0000 UTC m=+406.244493257"
Jul 07 16:25:08.153511 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.153475    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"]
Jul 07 16:25:08.157188 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.157166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.159373 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.159348    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:25:08.159489 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.159448    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 16:25:08.160333 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.160313    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lrgp4\""
Jul 07 16:25:08.160464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.160349    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 16:25:08.160464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.160356    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 16:25:08.160464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.160386    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 16:25:08.169388 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.169366    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"]
Jul 07 16:25:08.245373 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.245339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rz68\" (UniqueName: \"kubernetes.io/projected/e9f7d01e-0276-439f-8473-6e1c3443d315-kube-api-access-5rz68\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.245571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.245400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9f7d01e-0276-439f-8473-6e1c3443d315-manager-config\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.245571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.245526    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9f7d01e-0276-439f-8473-6e1c3443d315-cert\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.245696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.245618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9f7d01e-0276-439f-8473-6e1c3443d315-metrics-cert\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.346299 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.346268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9f7d01e-0276-439f-8473-6e1c3443d315-cert\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.346498 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.346334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9f7d01e-0276-439f-8473-6e1c3443d315-metrics-cert\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.346498 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.346388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rz68\" (UniqueName: \"kubernetes.io/projected/e9f7d01e-0276-439f-8473-6e1c3443d315-kube-api-access-5rz68\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.346498 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.346434    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9f7d01e-0276-439f-8473-6e1c3443d315-manager-config\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.347295 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.347270    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9f7d01e-0276-439f-8473-6e1c3443d315-manager-config\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.349050 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.349018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9f7d01e-0276-439f-8473-6e1c3443d315-metrics-cert\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.350015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.349996    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9f7d01e-0276-439f-8473-6e1c3443d315-cert\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.360599 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.360569    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rz68\" (UniqueName: \"kubernetes.io/projected/e9f7d01e-0276-439f-8473-6e1c3443d315-kube-api-access-5rz68\") pod \"lws-controller-manager-5cb66b9dcc-gpj8j\" (UID: \"e9f7d01e-0276-439f-8473-6e1c3443d315\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.467496 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.467396    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:08.605467 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:08.605440    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"]
Jul 07 16:25:08.608120 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:25:08.608093    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f7d01e_0276_439f_8473_6e1c3443d315.slice/crio-2b79deaf73bc775ad068ca7412f151a17e786f022601be8e7d6bef24f7c8d024 WatchSource:0}: Error finding container 2b79deaf73bc775ad068ca7412f151a17e786f022601be8e7d6bef24f7c8d024: Status 404 returned error can't find the container with id 2b79deaf73bc775ad068ca7412f151a17e786f022601be8e7d6bef24f7c8d024
Jul 07 16:25:09.385052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:09.385011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j" event={"ID":"e9f7d01e-0276-439f-8473-6e1c3443d315","Type":"ContainerStarted","Data":"2b79deaf73bc775ad068ca7412f151a17e786f022601be8e7d6bef24f7c8d024"}
Jul 07 16:25:11.397448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:11.397409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j" event={"ID":"e9f7d01e-0276-439f-8473-6e1c3443d315","Type":"ContainerStarted","Data":"e5b6d06a29cb8a83e137e6d05d4eace8ae39c25c5c3135b6d3010d7306d28f50"}
Jul 07 16:25:11.397945 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:11.397536    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:25:11.424629 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:11.424567    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j" podStartSLOduration=0.949368267 podStartE2EDuration="3.424548634s" totalImagesPullingTime="2.475180367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:11.424185677 +0000 UTC m=+411.275799863" watchObservedRunningTime="2026-07-07 16:25:11.424548634 +0000 UTC m=+411.276162799"
Jul 07 16:25:12.299307 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.299267    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"]
Jul 07 16:25:12.299552 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.299506    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerName="discovery" containerID="cri-o://a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142" gracePeriod=30
Jul 07 16:25:12.371265 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.371228    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mshxp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.23:8080/ready\": dial tcp 10.133.0.23:8080: connect: connection refused" start-of-body=
Jul 07 16:25:12.371427 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.371291    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.23:8080/ready\": dial tcp 10.133.0.23:8080: connect: connection refused"
Jul 07 16:25:12.544585 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.544552    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:12.590233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590144    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-dns-cert\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590217    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-ca-configmap\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590244    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-local-certs\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590269    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-cacerts\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590303    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-token\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590336    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsp82\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-kube-api-access-jsp82\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590384    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-kubeconfig\") pod \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\" (UID: \"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc\") "
Jul 07 16:25:12.590729 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.590692    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:25:12.592743 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.592708    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-local-certs" (OuterVolumeSpecName: "local-certs") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:25:12.592918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.592797    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-cacerts" (OuterVolumeSpecName: "cacerts") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:25:12.592918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.592890    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:25:12.592918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.592891    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:25:12.593189 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.593168    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-kube-api-access-jsp82" (OuterVolumeSpecName: "kube-api-access-jsp82") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "kube-api-access-jsp82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:25:12.593268 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.593250    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" (UID: "4c88e71d-f468-42f4-99bc-6fbed3d7fdfc"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:25:12.691630 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691603    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-token\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:12.691630 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691629    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsp82\" (UniqueName: \"kubernetes.io/projected/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-kube-api-access-jsp82\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:12.691783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691640    2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-kubeconfig\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:12.691783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691649    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-dns-cert\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:12.691783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691658    2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-istio-csr-ca-configmap\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:12.691783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691671    2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-local-certs\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:12.691783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:12.691684    2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc-cacerts\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:25:13.408121 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.408089    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerID="a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142" exitCode=0
Jul 07 16:25:13.408299 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.408139    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"
Jul 07 16:25:13.408299 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.408141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" event={"ID":"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc","Type":"ContainerDied","Data":"a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142"}
Jul 07 16:25:13.408299 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.408269    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mshxp" event={"ID":"4c88e71d-f468-42f4-99bc-6fbed3d7fdfc","Type":"ContainerDied","Data":"f69088d8be2d6bc968c9edab2b9d609a7b55f95cbf3e170e6141c867fa0fe6b2"}
Jul 07 16:25:13.408443 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.408300    2573 scope.go:117] "RemoveContainer" containerID="a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142"
Jul 07 16:25:13.416803 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.416789    2573 scope.go:117] "RemoveContainer" containerID="a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142"
Jul 07 16:25:13.417103 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:25:13.417084    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142\": container with ID starting with a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142 not found: ID does not exist" containerID="a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142"
Jul 07 16:25:13.417155 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.417111    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142"} err="failed to get container status \"a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142\": rpc error: code = NotFound desc = could not find container \"a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142\": container with ID starting with a76f8c4ff61c2ce42e49889f8c41849e42ddd00e586576c5b69647bc143ab142 not found: ID does not exist"
Jul 07 16:25:13.425113 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.425090    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"]
Jul 07 16:25:13.429214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:13.429194    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mshxp"]
Jul 07 16:25:14.658768 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:14.658736    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" path="/var/lib/kubelet/pods/4c88e71d-f468-42f4-99bc-6fbed3d7fdfc/volumes"
Jul 07 16:25:22.403698 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:25:22.403664    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-gpj8j"
Jul 07 16:26:00.463263 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.463232    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m89dp"]
Jul 07 16:26:00.463663 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.463579    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerName="discovery"
Jul 07 16:26:00.463663 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.463590    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerName="discovery"
Jul 07 16:26:00.463742 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.463669    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c88e71d-f468-42f4-99bc-6fbed3d7fdfc" containerName="discovery"
Jul 07 16:26:00.466901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.466877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:00.469825 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.469802    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 16:26:00.469973 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.469851    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 16:26:00.470565 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.470549    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-g4pvs\""
Jul 07 16:26:00.480199 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.480173    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m89dp"]
Jul 07 16:26:00.509606 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.509579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp92t\" (UniqueName: \"kubernetes.io/projected/3624f4d6-109f-408b-80e5-e81c6d3dc1c7-kube-api-access-rp92t\") pod \"kuadrant-operator-catalog-m89dp\" (UID: \"3624f4d6-109f-408b-80e5-e81c6d3dc1c7\") " pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:00.610282 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.610254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp92t\" (UniqueName: \"kubernetes.io/projected/3624f4d6-109f-408b-80e5-e81c6d3dc1c7-kube-api-access-rp92t\") pod \"kuadrant-operator-catalog-m89dp\" (UID: \"3624f4d6-109f-408b-80e5-e81c6d3dc1c7\") " pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:00.620559 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.620533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp92t\" (UniqueName: \"kubernetes.io/projected/3624f4d6-109f-408b-80e5-e81c6d3dc1c7-kube-api-access-rp92t\") pod \"kuadrant-operator-catalog-m89dp\" (UID: \"3624f4d6-109f-408b-80e5-e81c6d3dc1c7\") " pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:00.778070 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.777988    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:00.819444 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.819413    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m89dp"]
Jul 07 16:26:00.908761 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:00.908737    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m89dp"]
Jul 07 16:26:00.910805 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:26:00.910782    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3624f4d6_109f_408b_80e5_e81c6d3dc1c7.slice/crio-adf8336e07017a2a6e7917a7ae95103050f1941949b9a9e20aed383bada281c4 WatchSource:0}: Error finding container adf8336e07017a2a6e7917a7ae95103050f1941949b9a9e20aed383bada281c4: Status 404 returned error can't find the container with id adf8336e07017a2a6e7917a7ae95103050f1941949b9a9e20aed383bada281c4
Jul 07 16:26:01.049295 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.049209    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j4f8"]
Jul 07 16:26:01.053756 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.053740    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:01.061720 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.061696    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j4f8"]
Jul 07 16:26:01.115011 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.114978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lklth\" (UniqueName: \"kubernetes.io/projected/4051db86-0cc7-40f2-95d8-80e84037dada-kube-api-access-lklth\") pod \"kuadrant-operator-catalog-4j4f8\" (UID: \"4051db86-0cc7-40f2-95d8-80e84037dada\") " pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:01.216393 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.216359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lklth\" (UniqueName: \"kubernetes.io/projected/4051db86-0cc7-40f2-95d8-80e84037dada-kube-api-access-lklth\") pod \"kuadrant-operator-catalog-4j4f8\" (UID: \"4051db86-0cc7-40f2-95d8-80e84037dada\") " pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:01.224900 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.224863    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lklth\" (UniqueName: \"kubernetes.io/projected/4051db86-0cc7-40f2-95d8-80e84037dada-kube-api-access-lklth\") pod \"kuadrant-operator-catalog-4j4f8\" (UID: \"4051db86-0cc7-40f2-95d8-80e84037dada\") " pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:01.363851 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.363778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:01.616372 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.616331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m89dp" event={"ID":"3624f4d6-109f-408b-80e5-e81c6d3dc1c7","Type":"ContainerStarted","Data":"adf8336e07017a2a6e7917a7ae95103050f1941949b9a9e20aed383bada281c4"}
Jul 07 16:26:01.667082 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:01.667002    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4j4f8"]
Jul 07 16:26:01.686851 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:26:01.686816    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4051db86_0cc7_40f2_95d8_80e84037dada.slice/crio-57919bcba5128b4346b18482a816ee3f85e1366aa1a8e2adc55730e836a59d5c WatchSource:0}: Error finding container 57919bcba5128b4346b18482a816ee3f85e1366aa1a8e2adc55730e836a59d5c: Status 404 returned error can't find the container with id 57919bcba5128b4346b18482a816ee3f85e1366aa1a8e2adc55730e836a59d5c
Jul 07 16:26:02.624519 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:02.624463    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8" event={"ID":"4051db86-0cc7-40f2-95d8-80e84037dada","Type":"ContainerStarted","Data":"57919bcba5128b4346b18482a816ee3f85e1366aa1a8e2adc55730e836a59d5c"}
Jul 07 16:26:03.630228 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.630192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m89dp" event={"ID":"3624f4d6-109f-408b-80e5-e81c6d3dc1c7","Type":"ContainerStarted","Data":"580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c"}
Jul 07 16:26:03.630673 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.630254    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-m89dp" podUID="3624f4d6-109f-408b-80e5-e81c6d3dc1c7" containerName="registry-server" containerID="cri-o://580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c" gracePeriod=2
Jul 07 16:26:03.631699 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.631676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8" event={"ID":"4051db86-0cc7-40f2-95d8-80e84037dada","Type":"ContainerStarted","Data":"8b900817631acc1a9fe232d598bde03624fd339ddbff01fe474379cc4a503ddb"}
Jul 07 16:26:03.648379 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.648333    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m89dp" podStartSLOduration=1.528327922 podStartE2EDuration="3.648318256s" totalImagesPullingTime="2.119990334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:26:03.646440047 +0000 UTC m=+463.498054217" watchObservedRunningTime="2026-07-07 16:26:03.648318256 +0000 UTC m=+463.499932430"
Jul 07 16:26:03.662518 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.662472    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8" podStartSLOduration=1.315600935 podStartE2EDuration="2.662457183s" totalImagesPullingTime="1.346856248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:26:03.661099589 +0000 UTC m=+463.512713763" watchObservedRunningTime="2026-07-07 16:26:03.662457183 +0000 UTC m=+463.514071356"
Jul 07 16:26:03.883848 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.883788    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:03.943477 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.943436    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp92t\" (UniqueName: \"kubernetes.io/projected/3624f4d6-109f-408b-80e5-e81c6d3dc1c7-kube-api-access-rp92t\") pod \"3624f4d6-109f-408b-80e5-e81c6d3dc1c7\" (UID: \"3624f4d6-109f-408b-80e5-e81c6d3dc1c7\") "
Jul 07 16:26:03.945626 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:03.945597    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3624f4d6-109f-408b-80e5-e81c6d3dc1c7-kube-api-access-rp92t" (OuterVolumeSpecName: "kube-api-access-rp92t") pod "3624f4d6-109f-408b-80e5-e81c6d3dc1c7" (UID: "3624f4d6-109f-408b-80e5-e81c6d3dc1c7"). InnerVolumeSpecName "kube-api-access-rp92t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:26:04.044256 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.044213    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp92t\" (UniqueName: \"kubernetes.io/projected/3624f4d6-109f-408b-80e5-e81c6d3dc1c7-kube-api-access-rp92t\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:26:04.637437 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.637402    2573 generic.go:356] "Generic (PLEG): container finished" podID="3624f4d6-109f-408b-80e5-e81c6d3dc1c7" containerID="580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c" exitCode=0
Jul 07 16:26:04.637437 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.637441    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m89dp"
Jul 07 16:26:04.637881 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.637476    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m89dp" event={"ID":"3624f4d6-109f-408b-80e5-e81c6d3dc1c7","Type":"ContainerDied","Data":"580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c"}
Jul 07 16:26:04.637881 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.637545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m89dp" event={"ID":"3624f4d6-109f-408b-80e5-e81c6d3dc1c7","Type":"ContainerDied","Data":"adf8336e07017a2a6e7917a7ae95103050f1941949b9a9e20aed383bada281c4"}
Jul 07 16:26:04.637881 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.637571    2573 scope.go:117] "RemoveContainer" containerID="580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c"
Jul 07 16:26:04.646543 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.646525    2573 scope.go:117] "RemoveContainer" containerID="580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c"
Jul 07 16:26:04.646841 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:26:04.646821    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c\": container with ID starting with 580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c not found: ID does not exist" containerID="580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c"
Jul 07 16:26:04.646901 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.646851    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c"} err="failed to get container status \"580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c\": rpc error: code = NotFound desc = could not find container \"580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c\": container with ID starting with 580616d3a0c930d3d60dac068e52a8b28db538f7a1a17132192fc0753271984c not found: ID does not exist"
Jul 07 16:26:04.659619 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.659596    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m89dp"]
Jul 07 16:26:04.660811 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:04.660790    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m89dp"]
Jul 07 16:26:06.657801 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:06.657767    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3624f4d6-109f-408b-80e5-e81c6d3dc1c7" path="/var/lib/kubelet/pods/3624f4d6-109f-408b-80e5-e81c6d3dc1c7/volumes"
Jul 07 16:26:11.364923 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:11.364887    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:11.365336 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:11.364981    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:11.387045 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:11.387022    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:11.691810 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:11.691784    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4j4f8"
Jul 07 16:26:32.213629 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.213590    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"]
Jul 07 16:26:32.214653 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.214624    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3624f4d6-109f-408b-80e5-e81c6d3dc1c7" containerName="registry-server"
Jul 07 16:26:32.214800 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.214789    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3624f4d6-109f-408b-80e5-e81c6d3dc1c7" containerName="registry-server"
Jul 07 16:26:32.214996 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.214983    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3624f4d6-109f-408b-80e5-e81c6d3dc1c7" containerName="registry-server"
Jul 07 16:26:32.222035 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.222012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:32.225856 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.225834    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lk2sn\""
Jul 07 16:26:32.241396 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.241370    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"]
Jul 07 16:26:32.284804 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.284763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqzf\" (UniqueName: \"kubernetes.io/projected/4c1dcc12-7f05-47bc-b4a7-17521b926bed-kube-api-access-mfqzf\") pod \"limitador-operator-controller-manager-859d7b78bd-tprjc\" (UID: \"4c1dcc12-7f05-47bc-b4a7-17521b926bed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:32.386036 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.385992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqzf\" (UniqueName: \"kubernetes.io/projected/4c1dcc12-7f05-47bc-b4a7-17521b926bed-kube-api-access-mfqzf\") pod \"limitador-operator-controller-manager-859d7b78bd-tprjc\" (UID: \"4c1dcc12-7f05-47bc-b4a7-17521b926bed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:32.396785 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.396754    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqzf\" (UniqueName: \"kubernetes.io/projected/4c1dcc12-7f05-47bc-b4a7-17521b926bed-kube-api-access-mfqzf\") pod \"limitador-operator-controller-manager-859d7b78bd-tprjc\" (UID: \"4c1dcc12-7f05-47bc-b4a7-17521b926bed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:32.536734 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.536643    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:32.670499 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.670474    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"]
Jul 07 16:26:32.672475 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:26:32.672444    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1dcc12_7f05_47bc_b4a7_17521b926bed.slice/crio-80fa573d02c6c393da55b25015e6ef44534c258f4b59f3897ff9e97fc50af5ed WatchSource:0}: Error finding container 80fa573d02c6c393da55b25015e6ef44534c258f4b59f3897ff9e97fc50af5ed: Status 404 returned error can't find the container with id 80fa573d02c6c393da55b25015e6ef44534c258f4b59f3897ff9e97fc50af5ed
Jul 07 16:26:32.757825 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:32.757780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc" event={"ID":"4c1dcc12-7f05-47bc-b4a7-17521b926bed","Type":"ContainerStarted","Data":"80fa573d02c6c393da55b25015e6ef44534c258f4b59f3897ff9e97fc50af5ed"}
Jul 07 16:26:34.774997 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:34.774940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc" event={"ID":"4c1dcc12-7f05-47bc-b4a7-17521b926bed","Type":"ContainerStarted","Data":"83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8"}
Jul 07 16:26:34.775352 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:34.775045    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:34.792212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:34.792170    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc" podStartSLOduration=1.204658924 podStartE2EDuration="2.792156195s" totalImagesPullingTime="1.587497271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:26:34.791262097 +0000 UTC m=+494.642876262" watchObservedRunningTime="2026-07-07 16:26:34.792156195 +0000 UTC m=+494.643770369"
Jul 07 16:26:36.259700 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.259661    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"]
Jul 07 16:26:36.263246 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.263223    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:36.265697 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.265675    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ghdcp\""
Jul 07 16:26:36.271498 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.271474    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"]
Jul 07 16:26:36.319676 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.319648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nt85\" (UniqueName: \"kubernetes.io/projected/e8bb7fff-a94a-475e-a34d-3b2370d474d9-kube-api-access-4nt85\") pod \"authorino-operator-75cc8d5cb7-ztvd7\" (UID: \"e8bb7fff-a94a-475e-a34d-3b2370d474d9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:36.421013 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.420977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nt85\" (UniqueName: \"kubernetes.io/projected/e8bb7fff-a94a-475e-a34d-3b2370d474d9-kube-api-access-4nt85\") pod \"authorino-operator-75cc8d5cb7-ztvd7\" (UID: \"e8bb7fff-a94a-475e-a34d-3b2370d474d9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:36.429367 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.429346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nt85\" (UniqueName: \"kubernetes.io/projected/e8bb7fff-a94a-475e-a34d-3b2370d474d9-kube-api-access-4nt85\") pod \"authorino-operator-75cc8d5cb7-ztvd7\" (UID: \"e8bb7fff-a94a-475e-a34d-3b2370d474d9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:36.573774 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.573688    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:36.706489 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.706462    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"]
Jul 07 16:26:36.709322 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:26:36.709279    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bb7fff_a94a_475e_a34d_3b2370d474d9.slice/crio-53f43c5d43eb616e2cf8129d24de10bd0f6bfad2f470feda4208f17c454633f2 WatchSource:0}: Error finding container 53f43c5d43eb616e2cf8129d24de10bd0f6bfad2f470feda4208f17c454633f2: Status 404 returned error can't find the container with id 53f43c5d43eb616e2cf8129d24de10bd0f6bfad2f470feda4208f17c454633f2
Jul 07 16:26:36.785197 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:36.785166    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7" event={"ID":"e8bb7fff-a94a-475e-a34d-3b2370d474d9","Type":"ContainerStarted","Data":"53f43c5d43eb616e2cf8129d24de10bd0f6bfad2f470feda4208f17c454633f2"}
Jul 07 16:26:39.802176 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:39.802139    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7" event={"ID":"e8bb7fff-a94a-475e-a34d-3b2370d474d9","Type":"ContainerStarted","Data":"3873d8605f8735fbe67ba3a484e9869058e2b17ddd9cba954a498c16e40ebed1"}
Jul 07 16:26:39.802595 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:39.802259    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:39.821573 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:39.821530    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7" podStartSLOduration=1.259552344 podStartE2EDuration="3.821518083s" totalImagesPullingTime="2.561965739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:26:39.819573774 +0000 UTC m=+499.671187944" watchObservedRunningTime="2026-07-07 16:26:39.821518083 +0000 UTC m=+499.673132256"
Jul 07 16:26:45.781927 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:45.781895    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:26:50.809175 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:50.809146    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvd7"
Jul 07 16:26:54.011580 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.011543    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"]
Jul 07 16:26:54.014869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.014851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.017217 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.017181    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 16:26:54.017465 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.017448    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 16:26:54.017683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.017663    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-468st\""
Jul 07 16:26:54.027288 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.027262    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"]
Jul 07 16:26:54.069206 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.069178    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c44be9-3996-4497-ae20-5d07b855fe71-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.069321 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.069213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwnsl\" (UniqueName: \"kubernetes.io/projected/54c44be9-3996-4497-ae20-5d07b855fe71-kube-api-access-dwnsl\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.069321 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.069253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54c44be9-3996-4497-ae20-5d07b855fe71-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.170418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.170386    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c44be9-3996-4497-ae20-5d07b855fe71-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.170538 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.170425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwnsl\" (UniqueName: \"kubernetes.io/projected/54c44be9-3996-4497-ae20-5d07b855fe71-kube-api-access-dwnsl\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.170538 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.170477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54c44be9-3996-4497-ae20-5d07b855fe71-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.170622 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:26:54.170551    2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 07 16:26:54.170622 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:26:54.170618    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c44be9-3996-4497-ae20-5d07b855fe71-plugin-serving-cert podName:54c44be9-3996-4497-ae20-5d07b855fe71 nodeName:}" failed. No retries permitted until 2026-07-07 16:26:54.670597928 +0000 UTC m=+514.522212096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/54c44be9-3996-4497-ae20-5d07b855fe71-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-kjzbs" (UID: "54c44be9-3996-4497-ae20-5d07b855fe71") : secret "plugin-serving-cert" not found
Jul 07 16:26:54.171164 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.171148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54c44be9-3996-4497-ae20-5d07b855fe71-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.188836 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.188815    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwnsl\" (UniqueName: \"kubernetes.io/projected/54c44be9-3996-4497-ae20-5d07b855fe71-kube-api-access-dwnsl\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.674733 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.674698    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c44be9-3996-4497-ae20-5d07b855fe71-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.677013 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.676989    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54c44be9-3996-4497-ae20-5d07b855fe71-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjzbs\" (UID: \"54c44be9-3996-4497-ae20-5d07b855fe71\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:54.934125 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:54.934026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"
Jul 07 16:26:55.064310 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:55.064284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs"]
Jul 07 16:26:55.066790 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:26:55.066752    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54c44be9_3996_4497_ae20_5d07b855fe71.slice/crio-a760781d39627754bc5a590dd4a4baac6d5da2f07063ef6bb26c3c2e9608b159 WatchSource:0}: Error finding container a760781d39627754bc5a590dd4a4baac6d5da2f07063ef6bb26c3c2e9608b159: Status 404 returned error can't find the container with id a760781d39627754bc5a590dd4a4baac6d5da2f07063ef6bb26c3c2e9608b159
Jul 07 16:26:55.873738 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:26:55.873703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs" event={"ID":"54c44be9-3996-4497-ae20-5d07b855fe71","Type":"ContainerStarted","Data":"a760781d39627754bc5a590dd4a4baac6d5da2f07063ef6bb26c3c2e9608b159"}
Jul 07 16:27:04.001314 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.001270    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"]
Jul 07 16:27:04.008254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.008230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.011545 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.011514    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kbc57\""
Jul 07 16:27:04.017450 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.017392    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"]
Jul 07 16:27:04.169007 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.168970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54aaf03b-6c55-4cb3-8700-22872ee814ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.169206 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.169026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjr87\" (UniqueName: \"kubernetes.io/projected/54aaf03b-6c55-4cb3-8700-22872ee814ea-kube-api-access-kjr87\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.270505 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.270419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54aaf03b-6c55-4cb3-8700-22872ee814ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.270505 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.270499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjr87\" (UniqueName: \"kubernetes.io/projected/54aaf03b-6c55-4cb3-8700-22872ee814ea-kube-api-access-kjr87\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.270835 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.270812    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54aaf03b-6c55-4cb3-8700-22872ee814ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.280303 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.280273    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjr87\" (UniqueName: \"kubernetes.io/projected/54aaf03b-6c55-4cb3-8700-22872ee814ea-kube-api-access-kjr87\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.322200 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.322166    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:04.624783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.624695    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"]
Jul 07 16:27:04.628707 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.628676    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"]
Jul 07 16:27:04.680286 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.680240    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"]
Jul 07 16:27:04.680508 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.680478    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" containerName="manager" containerID="cri-o://83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8" gracePeriod=2
Jul 07 16:27:04.682865 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:04.682820    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tprjc\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:04.686197 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.686145    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"]
Jul 07 16:27:04.716577 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.716545    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"]
Jul 07 16:27:04.717058 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.717039    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" containerName="manager"
Jul 07 16:27:04.717058 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.717060    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" containerName="manager"
Jul 07 16:27:04.717251 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.717179    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" containerName="manager"
Jul 07 16:27:04.720483 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.720464    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:04.744876 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.744541    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"]
Jul 07 16:27:04.762176 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:04.762137    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tprjc\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:04.877430 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.877346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c42k\" (UniqueName: \"kubernetes.io/projected/a86e33a2-17c4-4a23-bab1-1fff6718c829-kube-api-access-2c42k\") pod \"limitador-operator-controller-manager-859d7b78bd-mdl5x\" (UID: \"a86e33a2-17c4-4a23-bab1-1fff6718c829\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:04.978132 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.978093    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c42k\" (UniqueName: \"kubernetes.io/projected/a86e33a2-17c4-4a23-bab1-1fff6718c829-kube-api-access-2c42k\") pod \"limitador-operator-controller-manager-859d7b78bd-mdl5x\" (UID: \"a86e33a2-17c4-4a23-bab1-1fff6718c829\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:04.989566 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:04.989535    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c42k\" (UniqueName: \"kubernetes.io/projected/a86e33a2-17c4-4a23-bab1-1fff6718c829-kube-api-access-2c42k\") pod \"limitador-operator-controller-manager-859d7b78bd-mdl5x\" (UID: \"a86e33a2-17c4-4a23-bab1-1fff6718c829\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:05.053819 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:05.053759    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:06.780285 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:06.780228    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.27:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 16:27:17.512199 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.512174    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:17.514876 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:17.514849    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tprjc\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:17.518659 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.518634    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"]
Jul 07 16:27:17.519869 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:27:17.519847    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86e33a2_17c4_4a23_bab1_1fff6718c829.slice/crio-52a125df8e197cf486f2ced879dd0e23a7d5115c658d0d820e84fe1c37b80b20 WatchSource:0}: Error finding container 52a125df8e197cf486f2ced879dd0e23a7d5115c658d0d820e84fe1c37b80b20: Status 404 returned error can't find the container with id 52a125df8e197cf486f2ced879dd0e23a7d5115c658d0d820e84fe1c37b80b20
Jul 07 16:27:17.704045 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.704016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfqzf\" (UniqueName: \"kubernetes.io/projected/4c1dcc12-7f05-47bc-b4a7-17521b926bed-kube-api-access-mfqzf\") pod \"4c1dcc12-7f05-47bc-b4a7-17521b926bed\" (UID: \"4c1dcc12-7f05-47bc-b4a7-17521b926bed\") "
Jul 07 16:27:17.706017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.705993    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1dcc12-7f05-47bc-b4a7-17521b926bed-kube-api-access-mfqzf" (OuterVolumeSpecName: "kube-api-access-mfqzf") pod "4c1dcc12-7f05-47bc-b4a7-17521b926bed" (UID: "4c1dcc12-7f05-47bc-b4a7-17521b926bed"). InnerVolumeSpecName "kube-api-access-mfqzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:27:17.805003 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.804976    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfqzf\" (UniqueName: \"kubernetes.io/projected/4c1dcc12-7f05-47bc-b4a7-17521b926bed-kube-api-access-mfqzf\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:27:17.995993 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.995887    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x" event={"ID":"a86e33a2-17c4-4a23-bab1-1fff6718c829","Type":"ContainerStarted","Data":"740fe6ad6f76826dc5fc9834bb99458002a7b0e58ab96cd0e4122953942f5a8c"}
Jul 07 16:27:17.995993 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.995938    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x" event={"ID":"a86e33a2-17c4-4a23-bab1-1fff6718c829","Type":"ContainerStarted","Data":"52a125df8e197cf486f2ced879dd0e23a7d5115c658d0d820e84fe1c37b80b20"}
Jul 07 16:27:17.996198 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.996083    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:17.997216 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.997190    2573 generic.go:356] "Generic (PLEG): container finished" podID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" containerID="83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8" exitCode=0
Jul 07 16:27:17.997338 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.997223    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:17.997338 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.997287    2573 scope.go:117] "RemoveContainer" containerID="83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8"
Jul 07 16:27:17.998745 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:17.998722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs" event={"ID":"54c44be9-3996-4497-ae20-5d07b855fe71","Type":"ContainerStarted","Data":"2e3f8c3922482baf3ec56ae30c378d7008d8c4ddc88a7f1589b1d73565af8f29"}
Jul 07 16:27:18.007484 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:18.007465    2573 scope.go:117] "RemoveContainer" containerID="83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8"
Jul 07 16:27:18.007761 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:18.007742    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8\": container with ID starting with 83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8 not found: ID does not exist" containerID="83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8"
Jul 07 16:27:18.007817 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:18.007768    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8"} err="failed to get container status \"83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8\": rpc error: code = NotFound desc = could not find container \"83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8\": container with ID starting with 83e0fea9ae699f88ef0e66fd8713a8bb154cace45dbf783e9dc1ff5ce797a8d8 not found: ID does not exist"
Jul 07 16:27:18.023659 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:18.023617    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x" podStartSLOduration=14.023595725 podStartE2EDuration="14.023595725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:18.02299463 +0000 UTC m=+537.874608811" watchObservedRunningTime="2026-07-07 16:27:18.023595725 +0000 UTC m=+537.875209898"
Jul 07 16:27:18.025040 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:18.025018    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tprjc\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:18.061103 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:18.061068    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tprjc\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tprjc"
Jul 07 16:27:18.061530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:18.061482    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjzbs" podStartSLOduration=2.674456321 podStartE2EDuration="25.061462952s" totalImagesPullingTime="22.387006631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:18.058644534 +0000 UTC m=+537.910258708" watchObservedRunningTime="2026-07-07 16:27:18.061462952 +0000 UTC m=+537.913077142"
Jul 07 16:27:18.658706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:18.658675    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c1dcc12-7f05-47bc-b4a7-17521b926bed" path="/var/lib/kubelet/pods/4c1dcc12-7f05-47bc-b4a7-17521b926bed/volumes"
Jul 07 16:27:19.907664 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:19.907628    2573 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-k5px4_kuadrant-system_54aaf03b-6c55-4cb3-8700-22872ee814ea_0(72f6f7c1b41f77bd8d80bb64a9eee1869bb445ef2235fec082d2f1386c13a2a6): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-k5px4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 07 16:27:19.907911 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:19.907690    2573 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-k5px4_kuadrant-system_54aaf03b-6c55-4cb3-8700-22872ee814ea_0(72f6f7c1b41f77bd8d80bb64a9eee1869bb445ef2235fec082d2f1386c13a2a6): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-k5px4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:20.008781 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.008750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:20.011466 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:20.011440    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="54aaf03b-6c55-4cb3-8700-22872ee814ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:20.016849 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.016830    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:20.019504 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:20.019476    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="54aaf03b-6c55-4cb3-8700-22872ee814ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:20.020709 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.020696    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjr87\" (UniqueName: \"kubernetes.io/projected/54aaf03b-6c55-4cb3-8700-22872ee814ea-kube-api-access-kjr87\") pod \"54aaf03b-6c55-4cb3-8700-22872ee814ea\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") "
Jul 07 16:27:20.020755 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.020741    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54aaf03b-6c55-4cb3-8700-22872ee814ea-extensions-socket-volume\") pod \"54aaf03b-6c55-4cb3-8700-22872ee814ea\" (UID: \"54aaf03b-6c55-4cb3-8700-22872ee814ea\") "
Jul 07 16:27:20.020988 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.020968    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54aaf03b-6c55-4cb3-8700-22872ee814ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "54aaf03b-6c55-4cb3-8700-22872ee814ea" (UID: "54aaf03b-6c55-4cb3-8700-22872ee814ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:27:20.022657 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.022638    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54aaf03b-6c55-4cb3-8700-22872ee814ea-kube-api-access-kjr87" (OuterVolumeSpecName: "kube-api-access-kjr87") pod "54aaf03b-6c55-4cb3-8700-22872ee814ea" (UID: "54aaf03b-6c55-4cb3-8700-22872ee814ea"). InnerVolumeSpecName "kube-api-access-kjr87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:27:20.121292 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.121267    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjr87\" (UniqueName: \"kubernetes.io/projected/54aaf03b-6c55-4cb3-8700-22872ee814ea-kube-api-access-kjr87\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:27:20.121292 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.121288    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54aaf03b-6c55-4cb3-8700-22872ee814ea-extensions-socket-volume\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:27:20.658061 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:20.658029    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="54aaf03b-6c55-4cb3-8700-22872ee814ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:20.659391 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:20.659370    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54aaf03b-6c55-4cb3-8700-22872ee814ea" path="/var/lib/kubelet/pods/54aaf03b-6c55-4cb3-8700-22872ee814ea/volumes"
Jul 07 16:27:21.013224 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:21.013188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:21.015488 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:21.015459    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="54aaf03b-6c55-4cb3-8700-22872ee814ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:21.017415 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:27:21.017392    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-k5px4\" is forbidden: User \"system:node:ip-10-0-135-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-243.ec2.internal' and this object" podUID="54aaf03b-6c55-4cb3-8700-22872ee814ea" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-k5px4"
Jul 07 16:27:29.006721 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:29.006686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdl5x"
Jul 07 16:27:48.469601 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.469566    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:27:48.529318 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.529284    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:27:48.529484 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.529393    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.531758 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.531730    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 16:27:48.565713 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.565684    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:27:48.660407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.660377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp8xh\" (UniqueName: \"kubernetes.io/projected/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-kube-api-access-lp8xh\") pod \"limitador-limitador-64c94fd64f-c9wr5\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.660407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.660413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-config-file\") pod \"limitador-limitador-64c94fd64f-c9wr5\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.761870 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.761798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp8xh\" (UniqueName: \"kubernetes.io/projected/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-kube-api-access-lp8xh\") pod \"limitador-limitador-64c94fd64f-c9wr5\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.761870 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.761830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-config-file\") pod \"limitador-limitador-64c94fd64f-c9wr5\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.762483 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.762465    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-config-file\") pod \"limitador-limitador-64c94fd64f-c9wr5\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.770358 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.770329    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp8xh\" (UniqueName: \"kubernetes.io/projected/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-kube-api-access-lp8xh\") pod \"limitador-limitador-64c94fd64f-c9wr5\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.842742 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.842714    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:48.977492 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:48.977470    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:27:48.979618 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:27:48.979590    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6e5ce4_24c1_4fc0_874e_4d1f98871b0a.slice/crio-2c2aa1e284ca9b2c06942f238cd86d205d37689f86b9b0021571414752d519ff WatchSource:0}: Error finding container 2c2aa1e284ca9b2c06942f238cd86d205d37689f86b9b0021571414752d519ff: Status 404 returned error can't find the container with id 2c2aa1e284ca9b2c06942f238cd86d205d37689f86b9b0021571414752d519ff
Jul 07 16:27:49.139216 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:49.139186    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5" event={"ID":"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a","Type":"ContainerStarted","Data":"2c2aa1e284ca9b2c06942f238cd86d205d37689f86b9b0021571414752d519ff"}
Jul 07 16:27:52.157999 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:52.157895    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5" event={"ID":"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a","Type":"ContainerStarted","Data":"b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719"}
Jul 07 16:27:52.157999 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:52.157966    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:27:52.176594 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:27:52.176546    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5" podStartSLOduration=1.2609025090000001 podStartE2EDuration="4.176531141s" totalImagesPullingTime="2.915628632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:52.174815956 +0000 UTC m=+572.026430124" watchObservedRunningTime="2026-07-07 16:27:52.176531141 +0000 UTC m=+572.028145313"
Jul 07 16:28:03.163498 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.163468    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:28:03.235822 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.235789    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:28:03.236009 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.235987    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5" podUID="3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" containerName="limitador" containerID="cri-o://b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719" gracePeriod=30
Jul 07 16:28:03.785185 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.785155    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:28:03.894490 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.894454    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-config-file\") pod \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") "
Jul 07 16:28:03.894666 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.894541    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp8xh\" (UniqueName: \"kubernetes.io/projected/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-kube-api-access-lp8xh\") pod \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\" (UID: \"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a\") "
Jul 07 16:28:03.894761 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.894737    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-config-file" (OuterVolumeSpecName: "config-file") pod "3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" (UID: "3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:28:03.894836 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.894824    2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-config-file\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:28:03.896441 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.896419    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-kube-api-access-lp8xh" (OuterVolumeSpecName: "kube-api-access-lp8xh") pod "3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" (UID: "3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a"). InnerVolumeSpecName "kube-api-access-lp8xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:03.995941 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:03.995905    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp8xh\" (UniqueName: \"kubernetes.io/projected/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a-kube-api-access-lp8xh\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:28:04.215750 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.213130    2573 generic.go:356] "Generic (PLEG): container finished" podID="3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" containerID="b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719" exitCode=0
Jul 07 16:28:04.215750 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.213262    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"
Jul 07 16:28:04.216280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.215919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5" event={"ID":"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a","Type":"ContainerDied","Data":"b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719"}
Jul 07 16:28:04.216280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.216057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c9wr5" event={"ID":"3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a","Type":"ContainerDied","Data":"2c2aa1e284ca9b2c06942f238cd86d205d37689f86b9b0021571414752d519ff"}
Jul 07 16:28:04.216280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.216115    2573 scope.go:117] "RemoveContainer" containerID="b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719"
Jul 07 16:28:04.228932 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.228913    2573 scope.go:117] "RemoveContainer" containerID="b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719"
Jul 07 16:28:04.229199 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:28:04.229182    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719\": container with ID starting with b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719 not found: ID does not exist" containerID="b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719"
Jul 07 16:28:04.229250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.229206    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719"} err="failed to get container status \"b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719\": rpc error: code = NotFound desc = could not find container \"b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719\": container with ID starting with b05d3094497c4c3ebfbbf5bac1c0a3c881cc756545c8b560d990424a1cdcb719 not found: ID does not exist"
Jul 07 16:28:04.238040 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.238019    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:28:04.242294 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.242273    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c9wr5"]
Jul 07 16:28:04.658664 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:04.658628    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" path="/var/lib/kubelet/pods/3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a/volumes"
Jul 07 16:28:06.900234 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.900200    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-hsppn"]
Jul 07 16:28:06.900719 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.900703    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" containerName="limitador"
Jul 07 16:28:06.900762 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.900723    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" containerName="limitador"
Jul 07 16:28:06.900825 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.900814    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6e5ce4-24c1-4fc0-874e-4d1f98871b0a" containerName="limitador"
Jul 07 16:28:06.905549 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.905533    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:06.908158 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.908134    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w6gcl\""
Jul 07 16:28:06.908278 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.908137    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 16:28:06.911563 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.911538    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hsppn"]
Jul 07 16:28:06.915368 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.915348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht852\" (UniqueName: \"kubernetes.io/projected/3b7cb6cd-f7d6-4060-a0d4-83ed78d688af-kube-api-access-ht852\") pod \"postgres-69fb4594cf-hsppn\" (UID: \"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af\") " pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:06.915476 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:06.915404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b7cb6cd-f7d6-4060-a0d4-83ed78d688af-data\") pod \"postgres-69fb4594cf-hsppn\" (UID: \"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af\") " pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:07.016660 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:07.016629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht852\" (UniqueName: \"kubernetes.io/projected/3b7cb6cd-f7d6-4060-a0d4-83ed78d688af-kube-api-access-ht852\") pod \"postgres-69fb4594cf-hsppn\" (UID: \"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af\") " pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:07.016825 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:07.016680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b7cb6cd-f7d6-4060-a0d4-83ed78d688af-data\") pod \"postgres-69fb4594cf-hsppn\" (UID: \"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af\") " pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:07.017113 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:07.017095    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b7cb6cd-f7d6-4060-a0d4-83ed78d688af-data\") pod \"postgres-69fb4594cf-hsppn\" (UID: \"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af\") " pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:07.025143 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:07.025117    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht852\" (UniqueName: \"kubernetes.io/projected/3b7cb6cd-f7d6-4060-a0d4-83ed78d688af-kube-api-access-ht852\") pod \"postgres-69fb4594cf-hsppn\" (UID: \"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af\") " pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:07.217116 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:07.217030    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:07.344702 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:07.344665    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hsppn"]
Jul 07 16:28:07.347527 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:28:07.347496    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7cb6cd_f7d6_4060_a0d4_83ed78d688af.slice/crio-c53736d62ddbd4f20646083e14e982032f7bbfa3c9917bcfea74381bd9fa84f7 WatchSource:0}: Error finding container c53736d62ddbd4f20646083e14e982032f7bbfa3c9917bcfea74381bd9fa84f7: Status 404 returned error can't find the container with id c53736d62ddbd4f20646083e14e982032f7bbfa3c9917bcfea74381bd9fa84f7
Jul 07 16:28:08.234320 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:08.234289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hsppn" event={"ID":"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af","Type":"ContainerStarted","Data":"c53736d62ddbd4f20646083e14e982032f7bbfa3c9917bcfea74381bd9fa84f7"}
Jul 07 16:28:13.263195 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:13.263154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hsppn" event={"ID":"3b7cb6cd-f7d6-4060-a0d4-83ed78d688af","Type":"ContainerStarted","Data":"0561c94c3e4309e0e7a2819981711d23b7dac06056bce258cd5f7ad0a548320b"}
Jul 07 16:28:13.263582 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:13.263242    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:13.280743 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:13.280699    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-hsppn" podStartSLOduration=2.125176814 podStartE2EDuration="7.280686688s" totalImagesPullingTime="5.155509874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:13.280253441 +0000 UTC m=+593.131867616" watchObservedRunningTime="2026-07-07 16:28:13.280686688 +0000 UTC m=+593.132300861"
Jul 07 16:28:19.297585 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:19.297557    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-hsppn"
Jul 07 16:28:20.605744 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:20.605715    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:28:20.609885 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:20.609863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:28:20.610829 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:20.610810    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:28:20.614866 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:20.614849    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:28:26.143141 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.143103    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d67797944-t2llr"]
Jul 07 16:28:26.304095 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.304068    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d67797944-t2llr"]
Jul 07 16:28:26.304251 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.304184    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.307968 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.307936    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kz4m6\""
Jul 07 16:28:26.308529 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.308514    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 16:28:26.308638 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.308547    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 16:28:26.330738 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.330718    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d97f49c6-68lcx"]
Jul 07 16:28:26.356232 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.356213    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-68lcx"]
Jul 07 16:28:26.356344 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.356295    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.392316 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.392291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g2rp\" (UniqueName: \"kubernetes.io/projected/132ae51a-88e0-4068-bd86-3c5141a8db04-kube-api-access-9g2rp\") pod \"maas-controller-7d67797944-t2llr\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") " pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.392428 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.392323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/132ae51a-88e0-4068-bd86-3c5141a8db04-webhook-cert\") pod \"maas-controller-7d67797944-t2llr\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") " pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.493735 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.493670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g2rp\" (UniqueName: \"kubernetes.io/projected/132ae51a-88e0-4068-bd86-3c5141a8db04-kube-api-access-9g2rp\") pod \"maas-controller-7d67797944-t2llr\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") " pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.493735 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.493707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/132ae51a-88e0-4068-bd86-3c5141a8db04-webhook-cert\") pod \"maas-controller-7d67797944-t2llr\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") " pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.493900 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.493762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d958bd94-5755-495f-8bdc-567ec2fae315-webhook-cert\") pod \"maas-controller-6d97f49c6-68lcx\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") " pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.493900 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.493784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pm9m\" (UniqueName: \"kubernetes.io/projected/d958bd94-5755-495f-8bdc-567ec2fae315-kube-api-access-4pm9m\") pod \"maas-controller-6d97f49c6-68lcx\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") " pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.496087 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.496065    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/132ae51a-88e0-4068-bd86-3c5141a8db04-webhook-cert\") pod \"maas-controller-7d67797944-t2llr\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") " pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.503969 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.503924    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g2rp\" (UniqueName: \"kubernetes.io/projected/132ae51a-88e0-4068-bd86-3c5141a8db04-kube-api-access-9g2rp\") pod \"maas-controller-7d67797944-t2llr\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") " pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.594765 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.594736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d958bd94-5755-495f-8bdc-567ec2fae315-webhook-cert\") pod \"maas-controller-6d97f49c6-68lcx\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") " pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.594882 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.594777    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pm9m\" (UniqueName: \"kubernetes.io/projected/d958bd94-5755-495f-8bdc-567ec2fae315-kube-api-access-4pm9m\") pod \"maas-controller-6d97f49c6-68lcx\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") " pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.597052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.597030    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d958bd94-5755-495f-8bdc-567ec2fae315-webhook-cert\") pod \"maas-controller-6d97f49c6-68lcx\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") " pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.604877 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.604853    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pm9m\" (UniqueName: \"kubernetes.io/projected/d958bd94-5755-495f-8bdc-567ec2fae315-kube-api-access-4pm9m\") pod \"maas-controller-6d97f49c6-68lcx\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") " pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.614529 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.614511    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:26.665865 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.665843    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:26.797682 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.797334    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d67797944-t2llr"]
Jul 07 16:28:26.800190 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:28:26.800160    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132ae51a_88e0_4068_bd86_3c5141a8db04.slice/crio-85ab271489c350a2e16f6ebfe4e27f96a8521a02b5b4dcac9b1a4a4a4e715c01 WatchSource:0}: Error finding container 85ab271489c350a2e16f6ebfe4e27f96a8521a02b5b4dcac9b1a4a4a4e715c01: Status 404 returned error can't find the container with id 85ab271489c350a2e16f6ebfe4e27f96a8521a02b5b4dcac9b1a4a4a4e715c01
Jul 07 16:28:26.824352 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:26.824331    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-68lcx"]
Jul 07 16:28:26.826087 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:28:26.826065    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd958bd94_5755_495f_8bdc_567ec2fae315.slice/crio-66fcac236fd7a4f97426871e217f1f63886732998728baeb5043de63481d9a14 WatchSource:0}: Error finding container 66fcac236fd7a4f97426871e217f1f63886732998728baeb5043de63481d9a14: Status 404 returned error can't find the container with id 66fcac236fd7a4f97426871e217f1f63886732998728baeb5043de63481d9a14
Jul 07 16:28:27.333905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:27.333870    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d67797944-t2llr" event={"ID":"132ae51a-88e0-4068-bd86-3c5141a8db04","Type":"ContainerStarted","Data":"85ab271489c350a2e16f6ebfe4e27f96a8521a02b5b4dcac9b1a4a4a4e715c01"}
Jul 07 16:28:27.335013 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:27.334991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d97f49c6-68lcx" event={"ID":"d958bd94-5755-495f-8bdc-567ec2fae315","Type":"ContainerStarted","Data":"66fcac236fd7a4f97426871e217f1f63886732998728baeb5043de63481d9a14"}
Jul 07 16:28:30.352910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:30.352868    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d67797944-t2llr" event={"ID":"132ae51a-88e0-4068-bd86-3c5141a8db04","Type":"ContainerStarted","Data":"5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7"}
Jul 07 16:28:30.353404 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:30.352938    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:30.354405 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:30.354382    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d97f49c6-68lcx" event={"ID":"d958bd94-5755-495f-8bdc-567ec2fae315","Type":"ContainerStarted","Data":"61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69"}
Jul 07 16:28:30.354533 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:30.354489    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:30.373638 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:30.373588    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d67797944-t2llr" podStartSLOduration=1.607676176 podStartE2EDuration="4.373574211s" totalImagesPullingTime="2.765898035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:30.37236909 +0000 UTC m=+610.223983265" watchObservedRunningTime="2026-07-07 16:28:30.373574211 +0000 UTC m=+610.225188390"
Jul 07 16:28:30.391320 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:30.391275    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d97f49c6-68lcx" podStartSLOduration=1.6395038149999999 podStartE2EDuration="4.391262893s" totalImagesPullingTime="2.751759078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:30.389733018 +0000 UTC m=+610.241347220" watchObservedRunningTime="2026-07-07 16:28:30.391262893 +0000 UTC m=+610.242877097"
Jul 07 16:28:41.365530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.365501    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:28:41.365905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.365575    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:41.427835 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.427796    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d67797944-t2llr"]
Jul 07 16:28:41.428033 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.428007    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d67797944-t2llr" podUID="132ae51a-88e0-4068-bd86-3c5141a8db04" containerName="manager" containerID="cri-o://5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7" gracePeriod=30
Jul 07 16:28:41.670041 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.670013    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:41.830932 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.830898    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/132ae51a-88e0-4068-bd86-3c5141a8db04-webhook-cert\") pod \"132ae51a-88e0-4068-bd86-3c5141a8db04\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") "
Jul 07 16:28:41.831128 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.830971    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g2rp\" (UniqueName: \"kubernetes.io/projected/132ae51a-88e0-4068-bd86-3c5141a8db04-kube-api-access-9g2rp\") pod \"132ae51a-88e0-4068-bd86-3c5141a8db04\" (UID: \"132ae51a-88e0-4068-bd86-3c5141a8db04\") "
Jul 07 16:28:41.833090 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.833058    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/132ae51a-88e0-4068-bd86-3c5141a8db04-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "132ae51a-88e0-4068-bd86-3c5141a8db04" (UID: "132ae51a-88e0-4068-bd86-3c5141a8db04"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:28:41.833196 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.833101    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/132ae51a-88e0-4068-bd86-3c5141a8db04-kube-api-access-9g2rp" (OuterVolumeSpecName: "kube-api-access-9g2rp") pod "132ae51a-88e0-4068-bd86-3c5141a8db04" (UID: "132ae51a-88e0-4068-bd86-3c5141a8db04"). InnerVolumeSpecName "kube-api-access-9g2rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:41.932473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.932404    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g2rp\" (UniqueName: \"kubernetes.io/projected/132ae51a-88e0-4068-bd86-3c5141a8db04-kube-api-access-9g2rp\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:28:41.932473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:41.932429    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/132ae51a-88e0-4068-bd86-3c5141a8db04-webhook-cert\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:28:42.410680 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.410648    2573 generic.go:356] "Generic (PLEG): container finished" podID="132ae51a-88e0-4068-bd86-3c5141a8db04" containerID="5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7" exitCode=0
Jul 07 16:28:42.410680 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.410684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d67797944-t2llr" event={"ID":"132ae51a-88e0-4068-bd86-3c5141a8db04","Type":"ContainerDied","Data":"5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7"}
Jul 07 16:28:42.411179 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.410692    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d67797944-t2llr"
Jul 07 16:28:42.411179 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.410722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d67797944-t2llr" event={"ID":"132ae51a-88e0-4068-bd86-3c5141a8db04","Type":"ContainerDied","Data":"85ab271489c350a2e16f6ebfe4e27f96a8521a02b5b4dcac9b1a4a4a4e715c01"}
Jul 07 16:28:42.411179 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.410745    2573 scope.go:117] "RemoveContainer" containerID="5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7"
Jul 07 16:28:42.422480 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.422461    2573 scope.go:117] "RemoveContainer" containerID="5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7"
Jul 07 16:28:42.422739 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:28:42.422720    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7\": container with ID starting with 5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7 not found: ID does not exist" containerID="5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7"
Jul 07 16:28:42.422803 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.422750    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7"} err="failed to get container status \"5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7\": rpc error: code = NotFound desc = could not find container \"5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7\": container with ID starting with 5d0749f49eec51d2b82eff608c6e9b19e819613c73a93e0b9185b123654c0bd7 not found: ID does not exist"
Jul 07 16:28:42.434018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.433996    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d67797944-t2llr"]
Jul 07 16:28:42.440505 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.440480    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d67797944-t2llr"]
Jul 07 16:28:42.658810 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:28:42.658776    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="132ae51a-88e0-4068-bd86-3c5141a8db04" path="/var/lib/kubelet/pods/132ae51a-88e0-4068-bd86-3c5141a8db04/volumes"
Jul 07 16:29:01.597915 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.597881    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7cdfbbc57c-t7hm7"]
Jul 07 16:29:01.598344 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.598245    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="132ae51a-88e0-4068-bd86-3c5141a8db04" containerName="manager"
Jul 07 16:29:01.598344 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.598258    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="132ae51a-88e0-4068-bd86-3c5141a8db04" containerName="manager"
Jul 07 16:29:01.598344 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.598326    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="132ae51a-88e0-4068-bd86-3c5141a8db04" containerName="manager"
Jul 07 16:29:01.600885 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.600868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.614923 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.614904    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w9m5\""
Jul 07 16:29:01.616580 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.616565    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 16:29:01.637098 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.637076    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cdfbbc57c-t7hm7"]
Jul 07 16:29:01.700313 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.700289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-openshift-service-ca\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.700462 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.700344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5nw6\" (UniqueName: \"kubernetes.io/projected/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-kube-api-access-f5nw6\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.700545 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.700524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-maas-api-tls\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.801133 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.801101    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5nw6\" (UniqueName: \"kubernetes.io/projected/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-kube-api-access-f5nw6\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.801281 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.801190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-maas-api-tls\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.801281 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.801247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-openshift-service-ca\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.801906 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.801883    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-openshift-service-ca\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.803475 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.803454    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-maas-api-tls\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.815159 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.815140    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5nw6\" (UniqueName: \"kubernetes.io/projected/c2f23e7d-7c02-4765-b010-7f6ab220dd6d-kube-api-access-f5nw6\") pod \"maas-api-7cdfbbc57c-t7hm7\" (UID: \"c2f23e7d-7c02-4765-b010-7f6ab220dd6d\") " pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:01.910384 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:01.910359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:02.044666 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.044643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cdfbbc57c-t7hm7"]
Jul 07 16:29:02.046829 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:29:02.046804    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f23e7d_7c02_4765_b010_7f6ab220dd6d.slice/crio-f930073c6eaad6562e74ff093f4407fa7a3d1bbeff5f4f7f5ba497b160d28cb4 WatchSource:0}: Error finding container f930073c6eaad6562e74ff093f4407fa7a3d1bbeff5f4f7f5ba497b160d28cb4: Status 404 returned error can't find the container with id f930073c6eaad6562e74ff093f4407fa7a3d1bbeff5f4f7f5ba497b160d28cb4
Jul 07 16:29:02.295063 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.294970    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9s4tz"]
Jul 07 16:29:02.302135 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.302106    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.305403 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.305377    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 16:29:02.305556 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.305388    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gqvxh\""
Jul 07 16:29:02.314678 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.314654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9s4tz"]
Jul 07 16:29:02.350621 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.350592    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-cg6b4"]
Jul 07 16:29:02.354378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.354359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.370235 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.370207    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-cg6b4"]
Jul 07 16:29:02.408027 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.408004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd29c741-6eed-4d29-9c79-9317747a527f-plugins-config-volume\") pod \"payload-processing-58f86c7798-9s4tz\" (UID: \"cd29c741-6eed-4d29-9c79-9317747a527f\") " pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.408168 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.408047    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a3b7d0-4d2f-4c49-8687-e1d474a09362-plugins-config-volume\") pod \"payload-pre-processing-7964457696-cg6b4\" (UID: \"f4a3b7d0-4d2f-4c49-8687-e1d474a09362\") " pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.408168 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.408086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfmk\" (UniqueName: \"kubernetes.io/projected/cd29c741-6eed-4d29-9c79-9317747a527f-kube-api-access-rnfmk\") pod \"payload-processing-58f86c7798-9s4tz\" (UID: \"cd29c741-6eed-4d29-9c79-9317747a527f\") " pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.408168 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.408123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4plwk\" (UniqueName: \"kubernetes.io/projected/f4a3b7d0-4d2f-4c49-8687-e1d474a09362-kube-api-access-4plwk\") pod \"payload-pre-processing-7964457696-cg6b4\" (UID: \"f4a3b7d0-4d2f-4c49-8687-e1d474a09362\") " pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.504255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.504215    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7" event={"ID":"c2f23e7d-7c02-4765-b010-7f6ab220dd6d","Type":"ContainerStarted","Data":"f930073c6eaad6562e74ff093f4407fa7a3d1bbeff5f4f7f5ba497b160d28cb4"}
Jul 07 16:29:02.508626 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.508607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a3b7d0-4d2f-4c49-8687-e1d474a09362-plugins-config-volume\") pod \"payload-pre-processing-7964457696-cg6b4\" (UID: \"f4a3b7d0-4d2f-4c49-8687-e1d474a09362\") " pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.508702 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.508643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfmk\" (UniqueName: \"kubernetes.io/projected/cd29c741-6eed-4d29-9c79-9317747a527f-kube-api-access-rnfmk\") pod \"payload-processing-58f86c7798-9s4tz\" (UID: \"cd29c741-6eed-4d29-9c79-9317747a527f\") " pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.508702 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.508668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4plwk\" (UniqueName: \"kubernetes.io/projected/f4a3b7d0-4d2f-4c49-8687-e1d474a09362-kube-api-access-4plwk\") pod \"payload-pre-processing-7964457696-cg6b4\" (UID: \"f4a3b7d0-4d2f-4c49-8687-e1d474a09362\") " pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.508820 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.508718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd29c741-6eed-4d29-9c79-9317747a527f-plugins-config-volume\") pod \"payload-processing-58f86c7798-9s4tz\" (UID: \"cd29c741-6eed-4d29-9c79-9317747a527f\") " pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.509439 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.509415    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd29c741-6eed-4d29-9c79-9317747a527f-plugins-config-volume\") pod \"payload-processing-58f86c7798-9s4tz\" (UID: \"cd29c741-6eed-4d29-9c79-9317747a527f\") " pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.509520 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.509445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a3b7d0-4d2f-4c49-8687-e1d474a09362-plugins-config-volume\") pod \"payload-pre-processing-7964457696-cg6b4\" (UID: \"f4a3b7d0-4d2f-4c49-8687-e1d474a09362\") " pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.517465 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.517446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfmk\" (UniqueName: \"kubernetes.io/projected/cd29c741-6eed-4d29-9c79-9317747a527f-kube-api-access-rnfmk\") pod \"payload-processing-58f86c7798-9s4tz\" (UID: \"cd29c741-6eed-4d29-9c79-9317747a527f\") " pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.517549 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.517529    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4plwk\" (UniqueName: \"kubernetes.io/projected/f4a3b7d0-4d2f-4c49-8687-e1d474a09362-kube-api-access-4plwk\") pod \"payload-pre-processing-7964457696-cg6b4\" (UID: \"f4a3b7d0-4d2f-4c49-8687-e1d474a09362\") " pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.613584 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.613499    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:02.664262 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.664235    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:02.759127 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.758974    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9s4tz"]
Jul 07 16:29:02.762672 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:29:02.762645    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd29c741_6eed_4d29_9c79_9317747a527f.slice/crio-a305b13c4d47fddf0cd222b7ab914754a435301a782c03907181bcab5b7a43a0 WatchSource:0}: Error finding container a305b13c4d47fddf0cd222b7ab914754a435301a782c03907181bcab5b7a43a0: Status 404 returned error can't find the container with id a305b13c4d47fddf0cd222b7ab914754a435301a782c03907181bcab5b7a43a0
Jul 07 16:29:02.809108 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:02.809081    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-cg6b4"]
Jul 07 16:29:02.809762 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:29:02.809728    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a3b7d0_4d2f_4c49_8687_e1d474a09362.slice/crio-9a87ed693c47bd0e4f0d6c5f4c0eda1ca2cddf6d96f2462469cd20b8885a0c89 WatchSource:0}: Error finding container 9a87ed693c47bd0e4f0d6c5f4c0eda1ca2cddf6d96f2462469cd20b8885a0c89: Status 404 returned error can't find the container with id 9a87ed693c47bd0e4f0d6c5f4c0eda1ca2cddf6d96f2462469cd20b8885a0c89
Jul 07 16:29:03.511562 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:03.511471    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz" event={"ID":"cd29c741-6eed-4d29-9c79-9317747a527f","Type":"ContainerStarted","Data":"a305b13c4d47fddf0cd222b7ab914754a435301a782c03907181bcab5b7a43a0"}
Jul 07 16:29:03.513022 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:03.512965    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4" event={"ID":"f4a3b7d0-4d2f-4c49-8687-e1d474a09362","Type":"ContainerStarted","Data":"9a87ed693c47bd0e4f0d6c5f4c0eda1ca2cddf6d96f2462469cd20b8885a0c89"}
Jul 07 16:29:05.525359 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.525315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz" event={"ID":"cd29c741-6eed-4d29-9c79-9317747a527f","Type":"ContainerStarted","Data":"dc7814dd3dcd3f60a321f58b5cbfff5f2cddbc41dadf1378c0376522cf98e365"}
Jul 07 16:29:05.525933 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.525398    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:05.527098 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.527041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4" event={"ID":"f4a3b7d0-4d2f-4c49-8687-e1d474a09362","Type":"ContainerStarted","Data":"9c1b64b9c66899dcc9a0b7be8ce77ea351006861376d2d03c6480ea979352491"}
Jul 07 16:29:05.527098 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.527092    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:05.528584 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.528562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7" event={"ID":"c2f23e7d-7c02-4765-b010-7f6ab220dd6d","Type":"ContainerStarted","Data":"e19e5445ca8cb579bb617a737df18d5d95f9dced7c59249e6df39cf09cce0c73"}
Jul 07 16:29:05.528706 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.528693    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:05.587340 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.587293    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz" podStartSLOduration=1.659343869 podStartE2EDuration="3.587279452s" totalImagesPullingTime="1.927935583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:05.555690288 +0000 UTC m=+645.407304479" watchObservedRunningTime="2026-07-07 16:29:05.587279452 +0000 UTC m=+645.438893625"
Jul 07 16:29:05.587730 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.587708    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7" podStartSLOduration=1.942824393 podStartE2EDuration="4.587701435s" totalImagesPullingTime="2.644877042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:05.582093299 +0000 UTC m=+645.433707475" watchObservedRunningTime="2026-07-07 16:29:05.587701435 +0000 UTC m=+645.439315607"
Jul 07 16:29:05.612280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:05.612228    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4" podStartSLOduration=1.727277288 podStartE2EDuration="3.612214719s" totalImagesPullingTime="1.884937431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:05.611100195 +0000 UTC m=+645.462714391" watchObservedRunningTime="2026-07-07 16:29:05.612214719 +0000 UTC m=+645.463828892"
Jul 07 16:29:11.539284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:11.539258    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7cdfbbc57c-t7hm7"
Jul 07 16:29:16.536759 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.536723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-9s4tz"
Jul 07 16:29:16.537257 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.536790    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-cg6b4"
Jul 07 16:29:16.770808 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.770777    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"]
Jul 07 16:29:16.774122 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.774107    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.776770 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.776749    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 16:29:16.776970 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.776940    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 16:29:16.777328 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.777305    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 16:29:16.777413 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.777395    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-crwj9\""
Jul 07 16:29:16.784168 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.784144    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"]
Jul 07 16:29:16.839992 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.839904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.839992 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.839940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.840136 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.840028    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gmr6\" (UniqueName: \"kubernetes.io/projected/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-kube-api-access-9gmr6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.840136 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.840077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.840136 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.840113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.840239 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.840142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941216 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941186    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gmr6\" (UniqueName: \"kubernetes.io/projected/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-kube-api-access-9gmr6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941349 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941349 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941349 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941490 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941355    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941490 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941754 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941831 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941759    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.941831 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.941792    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.943464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.943445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.943854 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.943834    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:16.949961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:16.949929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gmr6\" (UniqueName: \"kubernetes.io/projected/af90d33d-c9e9-4e4b-ae9b-233cbc83ec34-kube-api-access-9gmr6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f\" (UID: \"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:17.085230 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:17.085187    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:17.222321 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:17.222297    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"]
Jul 07 16:29:17.225471 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:29:17.225444    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf90d33d_c9e9_4e4b_ae9b_233cbc83ec34.slice/crio-a84eb5f61fa74a5761386477f733ac4c8a9c73ef734b0c944ddcd02f457b5306 WatchSource:0}: Error finding container a84eb5f61fa74a5761386477f733ac4c8a9c73ef734b0c944ddcd02f457b5306: Status 404 returned error can't find the container with id a84eb5f61fa74a5761386477f733ac4c8a9c73ef734b0c944ddcd02f457b5306
Jul 07 16:29:17.593333 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:17.593293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f" event={"ID":"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34","Type":"ContainerStarted","Data":"a84eb5f61fa74a5761386477f733ac4c8a9c73ef734b0c944ddcd02f457b5306"}
Jul 07 16:29:18.599746 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:18.599708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f" event={"ID":"af90d33d-c9e9-4e4b-ae9b-233cbc83ec34","Type":"ContainerStarted","Data":"c1269acbaa2a55a86bb974d8f4fd70ac45a1f7021c177a0995c0d467311f3a56"}
Jul 07 16:29:18.620037 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:18.619994    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f" podStartSLOduration=1.425516429 podStartE2EDuration="2.619979982s" totalImagesPullingTime="1.194463553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:18.619355814 +0000 UTC m=+658.470969987" watchObservedRunningTime="2026-07-07 16:29:18.619979982 +0000 UTC m=+658.471594155"
Jul 07 16:29:24.701389 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.701360    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"]
Jul 07 16:29:24.706231 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.706211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.709432 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.709414    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 16:29:24.732111 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.732086    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"]
Jul 07 16:29:24.815513 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.815486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.815678 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.815529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b08560-db53-400b-915a-37003197f3d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.815678 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.815556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.815678 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.815630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.815791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.815687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnssk\" (UniqueName: \"kubernetes.io/projected/13b08560-db53-400b-915a-37003197f3d2-kube-api-access-cnssk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.815791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.815718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.916861 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.916829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b08560-db53-400b-915a-37003197f3d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.916870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.916896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.916925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnssk\" (UniqueName: \"kubernetes.io/projected/13b08560-db53-400b-915a-37003197f3d2-kube-api-access-cnssk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.916972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.917046    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.917397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917488 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.917418    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.917488 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.917462    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.919184 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.919160    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13b08560-db53-400b-915a-37003197f3d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.919341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.919324    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13b08560-db53-400b-915a-37003197f3d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:24.925243 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:24.925217    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnssk\" (UniqueName: \"kubernetes.io/projected/13b08560-db53-400b-915a-37003197f3d2-kube-api-access-cnssk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hgxz\" (UID: \"13b08560-db53-400b-915a-37003197f3d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:25.016226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:25.016147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:25.170082 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:25.170058    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"]
Jul 07 16:29:25.171786 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:29:25.171763    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b08560_db53_400b_915a_37003197f3d2.slice/crio-71654142809d6446de85fe4e3449bafa421cd8e47a71c3bc45cdd56bcc5d32f3 WatchSource:0}: Error finding container 71654142809d6446de85fe4e3449bafa421cd8e47a71c3bc45cdd56bcc5d32f3: Status 404 returned error can't find the container with id 71654142809d6446de85fe4e3449bafa421cd8e47a71c3bc45cdd56bcc5d32f3
Jul 07 16:29:25.635331 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:25.635241    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz" event={"ID":"13b08560-db53-400b-915a-37003197f3d2","Type":"ContainerStarted","Data":"04a5a4c4a1239186bdd947781ff4e9d987d0b4892116f133586cbafe7ac79a2c"}
Jul 07 16:29:25.635331 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:25.635312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz" event={"ID":"13b08560-db53-400b-915a-37003197f3d2","Type":"ContainerStarted","Data":"71654142809d6446de85fe4e3449bafa421cd8e47a71c3bc45cdd56bcc5d32f3"}
Jul 07 16:29:25.664823 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:25.664772    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz" podStartSLOduration=1.454473804 podStartE2EDuration="1.664756052s" totalImagesPullingTime="210.282248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:25.663260072 +0000 UTC m=+665.514874245" watchObservedRunningTime="2026-07-07 16:29:25.664756052 +0000 UTC m=+665.516370225"
Jul 07 16:29:27.086288 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:27.086248    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:27.086772 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:27.086316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:27.098812 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:27.098779    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:27.655911 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:27.655874    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f"
Jul 07 16:29:35.016895 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:35.016864    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:35.017295 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:35.016942    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:35.030339 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:35.030316    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:29:35.698835 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:29:35.698799    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hgxz"
Jul 07 16:30:00.140163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.140115    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724030-vgxlq"]
Jul 07 16:30:00.145964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.145931    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:00.152684 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.152653    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724030-vgxlq"]
Jul 07 16:30:00.235749 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.235713    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hk7\" (UniqueName: \"kubernetes.io/projected/2e365a39-505a-4dce-98b1-c2e9e5f32d4e-kube-api-access-54hk7\") pod \"maas-api-key-cleanup-29724030-vgxlq\" (UID: \"2e365a39-505a-4dce-98b1-c2e9e5f32d4e\") " pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:00.337023 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.336987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hk7\" (UniqueName: \"kubernetes.io/projected/2e365a39-505a-4dce-98b1-c2e9e5f32d4e-kube-api-access-54hk7\") pod \"maas-api-key-cleanup-29724030-vgxlq\" (UID: \"2e365a39-505a-4dce-98b1-c2e9e5f32d4e\") " pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:00.347161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.347128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hk7\" (UniqueName: \"kubernetes.io/projected/2e365a39-505a-4dce-98b1-c2e9e5f32d4e-kube-api-access-54hk7\") pod \"maas-api-key-cleanup-29724030-vgxlq\" (UID: \"2e365a39-505a-4dce-98b1-c2e9e5f32d4e\") " pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:00.458526 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.458441    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:00.600874 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.600846    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724030-vgxlq"]
Jul 07 16:30:00.603123 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:30:00.603094    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e365a39_505a_4dce_98b1_c2e9e5f32d4e.slice/crio-48de5d7d1fd4904e8dfd5180aeb9e4744cfe6192e516844c90358debde37e6b9 WatchSource:0}: Error finding container 48de5d7d1fd4904e8dfd5180aeb9e4744cfe6192e516844c90358debde37e6b9: Status 404 returned error can't find the container with id 48de5d7d1fd4904e8dfd5180aeb9e4744cfe6192e516844c90358debde37e6b9
Jul 07 16:30:00.605558 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.605540    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:30:00.803673 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:00.803589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq" event={"ID":"2e365a39-505a-4dce-98b1-c2e9e5f32d4e","Type":"ContainerStarted","Data":"48de5d7d1fd4904e8dfd5180aeb9e4744cfe6192e516844c90358debde37e6b9"}
Jul 07 16:30:04.827735 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:04.827680    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq" event={"ID":"2e365a39-505a-4dce-98b1-c2e9e5f32d4e","Type":"ContainerStarted","Data":"7e0e7349ab9c03f80cc083a317a11ac19be93d85411f33a9027f0a8b1ee149f8"}
Jul 07 16:30:04.854195 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:04.854143    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq" podStartSLOduration=1.410886027 podStartE2EDuration="4.854127119s" totalImagesPullingTime="3.443241092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:04.85308794 +0000 UTC m=+704.704702115" watchObservedRunningTime="2026-07-07 16:30:04.854127119 +0000 UTC m=+704.705741292"
Jul 07 16:30:05.834926 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:05.834893    2573 generic.go:356] "Generic (PLEG): container finished" podID="2e365a39-505a-4dce-98b1-c2e9e5f32d4e" containerID="7e0e7349ab9c03f80cc083a317a11ac19be93d85411f33a9027f0a8b1ee149f8" exitCode=0
Jul 07 16:30:05.835309 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:05.834931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq" event={"ID":"2e365a39-505a-4dce-98b1-c2e9e5f32d4e","Type":"ContainerDied","Data":"7e0e7349ab9c03f80cc083a317a11ac19be93d85411f33a9027f0a8b1ee149f8"}
Jul 07 16:30:06.969392 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:06.969369    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:07.105271 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:07.105186    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54hk7\" (UniqueName: \"kubernetes.io/projected/2e365a39-505a-4dce-98b1-c2e9e5f32d4e-kube-api-access-54hk7\") pod \"2e365a39-505a-4dce-98b1-c2e9e5f32d4e\" (UID: \"2e365a39-505a-4dce-98b1-c2e9e5f32d4e\") "
Jul 07 16:30:07.107139 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:07.107116    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e365a39-505a-4dce-98b1-c2e9e5f32d4e-kube-api-access-54hk7" (OuterVolumeSpecName: "kube-api-access-54hk7") pod "2e365a39-505a-4dce-98b1-c2e9e5f32d4e" (UID: "2e365a39-505a-4dce-98b1-c2e9e5f32d4e"). InnerVolumeSpecName "kube-api-access-54hk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:30:07.205931 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:07.205899    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54hk7\" (UniqueName: \"kubernetes.io/projected/2e365a39-505a-4dce-98b1-c2e9e5f32d4e-kube-api-access-54hk7\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:30:07.846254 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:07.846224    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq"
Jul 07 16:30:07.846418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:07.846262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724030-vgxlq" event={"ID":"2e365a39-505a-4dce-98b1-c2e9e5f32d4e","Type":"ContainerDied","Data":"48de5d7d1fd4904e8dfd5180aeb9e4744cfe6192e516844c90358debde37e6b9"}
Jul 07 16:30:07.846418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:30:07.846309    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48de5d7d1fd4904e8dfd5180aeb9e4744cfe6192e516844c90358debde37e6b9"
Jul 07 16:32:23.132831 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.132798    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-68lcx"]
Jul 07 16:32:23.133427 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.133021    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d97f49c6-68lcx" podUID="d958bd94-5755-495f-8bdc-567ec2fae315" containerName="manager" containerID="cri-o://61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69" gracePeriod=30
Jul 07 16:32:23.384024 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.383968    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:32:23.451321 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.451291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d958bd94-5755-495f-8bdc-567ec2fae315-webhook-cert\") pod \"d958bd94-5755-495f-8bdc-567ec2fae315\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") "
Jul 07 16:32:23.451473 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.451333    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pm9m\" (UniqueName: \"kubernetes.io/projected/d958bd94-5755-495f-8bdc-567ec2fae315-kube-api-access-4pm9m\") pod \"d958bd94-5755-495f-8bdc-567ec2fae315\" (UID: \"d958bd94-5755-495f-8bdc-567ec2fae315\") "
Jul 07 16:32:23.453420 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.453389    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d958bd94-5755-495f-8bdc-567ec2fae315-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d958bd94-5755-495f-8bdc-567ec2fae315" (UID: "d958bd94-5755-495f-8bdc-567ec2fae315"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:32:23.453528 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.453455    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d958bd94-5755-495f-8bdc-567ec2fae315-kube-api-access-4pm9m" (OuterVolumeSpecName: "kube-api-access-4pm9m") pod "d958bd94-5755-495f-8bdc-567ec2fae315" (UID: "d958bd94-5755-495f-8bdc-567ec2fae315"). InnerVolumeSpecName "kube-api-access-4pm9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:32:23.494049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.494016    2573 generic.go:356] "Generic (PLEG): container finished" podID="d958bd94-5755-495f-8bdc-567ec2fae315" containerID="61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69" exitCode=0
Jul 07 16:32:23.494161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.494067    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d97f49c6-68lcx"
Jul 07 16:32:23.494161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.494080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d97f49c6-68lcx" event={"ID":"d958bd94-5755-495f-8bdc-567ec2fae315","Type":"ContainerDied","Data":"61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69"}
Jul 07 16:32:23.494161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.494134    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d97f49c6-68lcx" event={"ID":"d958bd94-5755-495f-8bdc-567ec2fae315","Type":"ContainerDied","Data":"66fcac236fd7a4f97426871e217f1f63886732998728baeb5043de63481d9a14"}
Jul 07 16:32:23.494266 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.494165    2573 scope.go:117] "RemoveContainer" containerID="61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69"
Jul 07 16:32:23.503521 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.503503    2573 scope.go:117] "RemoveContainer" containerID="61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69"
Jul 07 16:32:23.503745 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:32:23.503728    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69\": container with ID starting with 61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69 not found: ID does not exist" containerID="61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69"
Jul 07 16:32:23.503793 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.503752    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69"} err="failed to get container status \"61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69\": rpc error: code = NotFound desc = could not find container \"61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69\": container with ID starting with 61131783967dd005b11a22496c9035fb68842dff79fb9badf5559712f6b92d69 not found: ID does not exist"
Jul 07 16:32:23.535870 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.535830    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-68lcx"]
Jul 07 16:32:23.539828 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.539801    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-68lcx"]
Jul 07 16:32:23.552383 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.552364    2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d958bd94-5755-495f-8bdc-567ec2fae315-webhook-cert\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:32:23.552472 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:23.552387    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pm9m\" (UniqueName: \"kubernetes.io/projected/d958bd94-5755-495f-8bdc-567ec2fae315-kube-api-access-4pm9m\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:32:24.301248 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301220    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d97f49c6-srzwm"]
Jul 07 16:32:24.301626 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301612    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e365a39-505a-4dce-98b1-c2e9e5f32d4e" containerName="cleanup"
Jul 07 16:32:24.301670 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301626    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e365a39-505a-4dce-98b1-c2e9e5f32d4e" containerName="cleanup"
Jul 07 16:32:24.301670 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301645    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d958bd94-5755-495f-8bdc-567ec2fae315" containerName="manager"
Jul 07 16:32:24.301670 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301650    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d958bd94-5755-495f-8bdc-567ec2fae315" containerName="manager"
Jul 07 16:32:24.301765 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301719    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e365a39-505a-4dce-98b1-c2e9e5f32d4e" containerName="cleanup"
Jul 07 16:32:24.301765 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.301726    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d958bd94-5755-495f-8bdc-567ec2fae315" containerName="manager"
Jul 07 16:32:24.306070 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.306043    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.308992 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.308970    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 16:32:24.308992 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.309000    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kz4m6\""
Jul 07 16:32:24.309560 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.309546    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 16:32:24.316094 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.316070    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-srzwm"]
Jul 07 16:32:24.359668 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.359646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx7j6\" (UniqueName: \"kubernetes.io/projected/d5d32387-f9b2-40ce-a3c8-2190a9c34242-kube-api-access-sx7j6\") pod \"maas-controller-6d97f49c6-srzwm\" (UID: \"d5d32387-f9b2-40ce-a3c8-2190a9c34242\") " pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.359800 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.359701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5d32387-f9b2-40ce-a3c8-2190a9c34242-webhook-cert\") pod \"maas-controller-6d97f49c6-srzwm\" (UID: \"d5d32387-f9b2-40ce-a3c8-2190a9c34242\") " pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.460596 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.460566    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5d32387-f9b2-40ce-a3c8-2190a9c34242-webhook-cert\") pod \"maas-controller-6d97f49c6-srzwm\" (UID: \"d5d32387-f9b2-40ce-a3c8-2190a9c34242\") " pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.460786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.460628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx7j6\" (UniqueName: \"kubernetes.io/projected/d5d32387-f9b2-40ce-a3c8-2190a9c34242-kube-api-access-sx7j6\") pod \"maas-controller-6d97f49c6-srzwm\" (UID: \"d5d32387-f9b2-40ce-a3c8-2190a9c34242\") " pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.462961 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.462929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5d32387-f9b2-40ce-a3c8-2190a9c34242-webhook-cert\") pod \"maas-controller-6d97f49c6-srzwm\" (UID: \"d5d32387-f9b2-40ce-a3c8-2190a9c34242\") " pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.468922 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.468898    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx7j6\" (UniqueName: \"kubernetes.io/projected/d5d32387-f9b2-40ce-a3c8-2190a9c34242-kube-api-access-sx7j6\") pod \"maas-controller-6d97f49c6-srzwm\" (UID: \"d5d32387-f9b2-40ce-a3c8-2190a9c34242\") " pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.616802 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.616721    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:24.661435 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.661392    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d958bd94-5755-495f-8bdc-567ec2fae315" path="/var/lib/kubelet/pods/d958bd94-5755-495f-8bdc-567ec2fae315/volumes"
Jul 07 16:32:24.753653 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:24.753626    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d97f49c6-srzwm"]
Jul 07 16:32:24.755756 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:32:24.755731    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d32387_f9b2_40ce_a3c8_2190a9c34242.slice/crio-8602e5ec57b7a24a5989217778bf0e3cf407f5c0141262d2fdac4833c70312a0 WatchSource:0}: Error finding container 8602e5ec57b7a24a5989217778bf0e3cf407f5c0141262d2fdac4833c70312a0: Status 404 returned error can't find the container with id 8602e5ec57b7a24a5989217778bf0e3cf407f5c0141262d2fdac4833c70312a0
Jul 07 16:32:25.507466 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:25.507376    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d97f49c6-srzwm" event={"ID":"d5d32387-f9b2-40ce-a3c8-2190a9c34242","Type":"ContainerStarted","Data":"c7b233999f75b5e7dc569dcf2602e081ba64b89fe7ecc973ac3f5e8f491f9ee8"}
Jul 07 16:32:25.507466 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:25.507441    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d97f49c6-srzwm" event={"ID":"d5d32387-f9b2-40ce-a3c8-2190a9c34242","Type":"ContainerStarted","Data":"8602e5ec57b7a24a5989217778bf0e3cf407f5c0141262d2fdac4833c70312a0"}
Jul 07 16:32:25.507845 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:25.507527    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:32:25.525959 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:25.525896    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d97f49c6-srzwm" podStartSLOduration=1.078085997 podStartE2EDuration="1.52588163s" totalImagesPullingTime="447.795633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:32:25.523864645 +0000 UTC m=+845.375478819" watchObservedRunningTime="2026-07-07 16:32:25.52588163 +0000 UTC m=+845.377495803"
Jul 07 16:32:36.519459 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:32:36.519430    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d97f49c6-srzwm"
Jul 07 16:33:20.649163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:33:20.649087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:33:20.649740 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:33:20.649638    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:33:20.653803 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:33:20.653784    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:33:20.654378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:33:20.654351    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:38:20.682284 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:38:20.682254    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:38:20.683775 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:38:20.683750    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:38:20.686449 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:38:20.686428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:38:20.687864 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:38:20.687845    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:43:20.711731 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:43:20.711701    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:43:20.714517 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:43:20.714492    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:43:20.715821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:43:20.715798    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:43:20.718822 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:43:20.718803    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:44:29.564339 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.564307    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"]
Jul 07 16:44:29.567403 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.567386    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.570211 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.570190    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-b15c8f0d-serving-cert\""
Jul 07 16:44:29.580872 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.580845    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"]
Jul 07 16:44:29.687423 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.687389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022814d2-2d8e-4611-9c9f-72a48ead6b2c-maas-api-tls\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.687628 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.687440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhff2\" (UniqueName: \"kubernetes.io/projected/022814d2-2d8e-4611-9c9f-72a48ead6b2c-kube-api-access-xhff2\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.687705 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.687634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022814d2-2d8e-4611-9c9f-72a48ead6b2c-openshift-service-ca\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.788637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.788599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022814d2-2d8e-4611-9c9f-72a48ead6b2c-openshift-service-ca\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.788637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.788639    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022814d2-2d8e-4611-9c9f-72a48ead6b2c-maas-api-tls\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.788874 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.788680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhff2\" (UniqueName: \"kubernetes.io/projected/022814d2-2d8e-4611-9c9f-72a48ead6b2c-kube-api-access-xhff2\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.789283 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.789262    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022814d2-2d8e-4611-9c9f-72a48ead6b2c-openshift-service-ca\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.791133 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.791111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022814d2-2d8e-4611-9c9f-72a48ead6b2c-maas-api-tls\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.797639 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.797608    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhff2\" (UniqueName: \"kubernetes.io/projected/022814d2-2d8e-4611-9c9f-72a48ead6b2c-kube-api-access-xhff2\") pod \"maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") " pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:29.878374 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:29.878288    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:30.013846 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:30.013820    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"]
Jul 07 16:44:30.016280 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:44:30.016250    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022814d2_2d8e_4611_9c9f_72a48ead6b2c.slice/crio-5c67b2eb59a1ceb6b8faa3d4820f29545588f7f4baf10787a9a3a183021b9ad2 WatchSource:0}: Error finding container 5c67b2eb59a1ceb6b8faa3d4820f29545588f7f4baf10787a9a3a183021b9ad2: Status 404 returned error can't find the container with id 5c67b2eb59a1ceb6b8faa3d4820f29545588f7f4baf10787a9a3a183021b9ad2
Jul 07 16:44:30.017611 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:30.017589    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:44:30.995411 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:30.995369    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc" event={"ID":"022814d2-2d8e-4611-9c9f-72a48ead6b2c","Type":"ContainerStarted","Data":"5c67b2eb59a1ceb6b8faa3d4820f29545588f7f4baf10787a9a3a183021b9ad2"}
Jul 07 16:44:32.003357 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:32.003305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc" event={"ID":"022814d2-2d8e-4611-9c9f-72a48ead6b2c","Type":"ContainerStarted","Data":"3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432"}
Jul 07 16:44:32.003815 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:32.003405    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:32.035667 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:32.035613    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc" podStartSLOduration=1.684555923 podStartE2EDuration="3.035597285s" totalImagesPullingTime="1.351041362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:44:32.033278871 +0000 UTC m=+1571.884893045" watchObservedRunningTime="2026-07-07 16:44:32.035597285 +0000 UTC m=+1571.887211457"
Jul 07 16:44:34.911611 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:34.911577    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"]
Jul 07 16:44:34.912128 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:34.911755    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc" podUID="022814d2-2d8e-4611-9c9f-72a48ead6b2c" containerName="maas-api" containerID="cri-o://3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432" gracePeriod=30
Jul 07 16:44:35.164941 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.164879    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:35.341855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.341817    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022814d2-2d8e-4611-9c9f-72a48ead6b2c-maas-api-tls\") pod \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") "
Jul 07 16:44:35.342067 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.341881    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhff2\" (UniqueName: \"kubernetes.io/projected/022814d2-2d8e-4611-9c9f-72a48ead6b2c-kube-api-access-xhff2\") pod \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") "
Jul 07 16:44:35.342067 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.342007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022814d2-2d8e-4611-9c9f-72a48ead6b2c-openshift-service-ca\") pod \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\" (UID: \"022814d2-2d8e-4611-9c9f-72a48ead6b2c\") "
Jul 07 16:44:35.342362 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.342337    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/022814d2-2d8e-4611-9c9f-72a48ead6b2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "022814d2-2d8e-4611-9c9f-72a48ead6b2c" (UID: "022814d2-2d8e-4611-9c9f-72a48ead6b2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:44:35.343891 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.343868    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/022814d2-2d8e-4611-9c9f-72a48ead6b2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "022814d2-2d8e-4611-9c9f-72a48ead6b2c" (UID: "022814d2-2d8e-4611-9c9f-72a48ead6b2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:44:35.344058 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.343901    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/022814d2-2d8e-4611-9c9f-72a48ead6b2c-kube-api-access-xhff2" (OuterVolumeSpecName: "kube-api-access-xhff2") pod "022814d2-2d8e-4611-9c9f-72a48ead6b2c" (UID: "022814d2-2d8e-4611-9c9f-72a48ead6b2c"). InnerVolumeSpecName "kube-api-access-xhff2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:44:35.442938 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.442853    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/022814d2-2d8e-4611-9c9f-72a48ead6b2c-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:44:35.442938 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.442882    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhff2\" (UniqueName: \"kubernetes.io/projected/022814d2-2d8e-4611-9c9f-72a48ead6b2c-kube-api-access-xhff2\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:44:35.442938 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:35.442892    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/022814d2-2d8e-4611-9c9f-72a48ead6b2c-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:44:36.024411 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.024375    2573 generic.go:356] "Generic (PLEG): container finished" podID="022814d2-2d8e-4611-9c9f-72a48ead6b2c" containerID="3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432" exitCode=0
Jul 07 16:44:36.024855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.024424    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"
Jul 07 16:44:36.024855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.024458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc" event={"ID":"022814d2-2d8e-4611-9c9f-72a48ead6b2c","Type":"ContainerDied","Data":"3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432"}
Jul 07 16:44:36.024855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.024508    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc" event={"ID":"022814d2-2d8e-4611-9c9f-72a48ead6b2c","Type":"ContainerDied","Data":"5c67b2eb59a1ceb6b8faa3d4820f29545588f7f4baf10787a9a3a183021b9ad2"}
Jul 07 16:44:36.024855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.024532    2573 scope.go:117] "RemoveContainer" containerID="3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432"
Jul 07 16:44:36.033494 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.033479    2573 scope.go:117] "RemoveContainer" containerID="3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432"
Jul 07 16:44:36.033732 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:44:36.033713    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432\": container with ID starting with 3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432 not found: ID does not exist" containerID="3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432"
Jul 07 16:44:36.033783 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.033746    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432"} err="failed to get container status \"3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432\": rpc error: code = NotFound desc = could not find container \"3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432\": container with ID starting with 3ef2e48fc14b3c0ce14521b4ad1c7bde18fe08dff05b7c27088aebf76e018432 not found: ID does not exist"
Jul 07 16:44:36.046295 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.046269    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"]
Jul 07 16:44:36.049778 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.049752    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-b15c8f0d-6b785bf8bf-25lwc"]
Jul 07 16:44:36.659713 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:36.659677    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="022814d2-2d8e-4611-9c9f-72a48ead6b2c" path="/var/lib/kubelet/pods/022814d2-2d8e-4611-9c9f-72a48ead6b2c/volumes"
Jul 07 16:44:42.287601 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.287566    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"]
Jul 07 16:44:42.288010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.287972    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="022814d2-2d8e-4611-9c9f-72a48ead6b2c" containerName="maas-api"
Jul 07 16:44:42.288010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.287983    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="022814d2-2d8e-4611-9c9f-72a48ead6b2c" containerName="maas-api"
Jul 07 16:44:42.288106 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.288052    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="022814d2-2d8e-4611-9c9f-72a48ead6b2c" containerName="maas-api"
Jul 07 16:44:42.292679 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.292659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.295398 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.295380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-3b3b9194-serving-cert\""
Jul 07 16:44:42.304685 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.304662    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"]
Jul 07 16:44:42.311931 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.311908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-openshift-service-ca\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.312054 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.311968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwwzl\" (UniqueName: \"kubernetes.io/projected/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-kube-api-access-wwwzl\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.312054 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.312033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.413267 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.413238    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwwzl\" (UniqueName: \"kubernetes.io/projected/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-kube-api-access-wwwzl\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.413413 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.413375    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.413476 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.413416    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-openshift-service-ca\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.413536 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:44:42.413516    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-3b3b9194-serving-cert: secret "maas-api-e2e-ait-3b3b9194-serving-cert" not found
Jul 07 16:44:42.413600 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:44:42.413589    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls podName:76b5bf22-448f-4183-bb6f-0fff9d83ddd0 nodeName:}" failed. No retries permitted until 2026-07-07 16:44:42.91357329 +0000 UTC m=+1582.765187440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls") pod "maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" (UID: "76b5bf22-448f-4183-bb6f-0fff9d83ddd0") : secret "maas-api-e2e-ait-3b3b9194-serving-cert" not found
Jul 07 16:44:42.414013 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.413997    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-openshift-service-ca\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.422065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.422043    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwwzl\" (UniqueName: \"kubernetes.io/projected/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-kube-api-access-wwwzl\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.917662 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.917630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:42.920050 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:42.920021    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls\") pod \"maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") " pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:43.203985 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:43.203870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:43.351389 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:43.351263    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"]
Jul 07 16:44:43.354199 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:44:43.354173    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b5bf22_448f_4183_bb6f_0fff9d83ddd0.slice/crio-d05807ef8e97fbfd7e3176554481106bbdd300618345af519f18ca87cab918bc WatchSource:0}: Error finding container d05807ef8e97fbfd7e3176554481106bbdd300618345af519f18ca87cab918bc: Status 404 returned error can't find the container with id d05807ef8e97fbfd7e3176554481106bbdd300618345af519f18ca87cab918bc
Jul 07 16:44:44.066773 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:44.066684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" event={"ID":"76b5bf22-448f-4183-bb6f-0fff9d83ddd0","Type":"ContainerStarted","Data":"c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831"}
Jul 07 16:44:44.066978 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:44.066777    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" event={"ID":"76b5bf22-448f-4183-bb6f-0fff9d83ddd0","Type":"ContainerStarted","Data":"d05807ef8e97fbfd7e3176554481106bbdd300618345af519f18ca87cab918bc"}
Jul 07 16:44:44.066978 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:44.066808    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:44.087355 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:44.087305    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" podStartSLOduration=1.750076465 podStartE2EDuration="2.087290257s" totalImagesPullingTime="337.213792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:44:44.085926399 +0000 UTC m=+1583.937540572" watchObservedRunningTime="2026-07-07 16:44:44.087290257 +0000 UTC m=+1583.938904429"
Jul 07 16:44:47.711545 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:47.711508    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"]
Jul 07 16:44:47.711980 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:47.711703    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" podUID="76b5bf22-448f-4183-bb6f-0fff9d83ddd0" containerName="maas-api" containerID="cri-o://c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831" gracePeriod=30
Jul 07 16:44:47.955927 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:47.955903    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:48.063874 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.063800    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-openshift-service-ca\") pod \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") "
Jul 07 16:44:48.064029 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.063887    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwwzl\" (UniqueName: \"kubernetes.io/projected/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-kube-api-access-wwwzl\") pod \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") "
Jul 07 16:44:48.064029 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.063915    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls\") pod \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\" (UID: \"76b5bf22-448f-4183-bb6f-0fff9d83ddd0\") "
Jul 07 16:44:48.064178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.064155    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76b5bf22-448f-4183-bb6f-0fff9d83ddd0" (UID: "76b5bf22-448f-4183-bb6f-0fff9d83ddd0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:44:48.066017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.065979    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-kube-api-access-wwwzl" (OuterVolumeSpecName: "kube-api-access-wwwzl") pod "76b5bf22-448f-4183-bb6f-0fff9d83ddd0" (UID: "76b5bf22-448f-4183-bb6f-0fff9d83ddd0"). InnerVolumeSpecName "kube-api-access-wwwzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:44:48.066017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.066006    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76b5bf22-448f-4183-bb6f-0fff9d83ddd0" (UID: "76b5bf22-448f-4183-bb6f-0fff9d83ddd0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:44:48.088937 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.088913    2573 generic.go:356] "Generic (PLEG): container finished" podID="76b5bf22-448f-4183-bb6f-0fff9d83ddd0" containerID="c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831" exitCode=0
Jul 07 16:44:48.089069 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.088974    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"
Jul 07 16:44:48.089069 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.088980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" event={"ID":"76b5bf22-448f-4183-bb6f-0fff9d83ddd0","Type":"ContainerDied","Data":"c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831"}
Jul 07 16:44:48.089069 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.089043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s" event={"ID":"76b5bf22-448f-4183-bb6f-0fff9d83ddd0","Type":"ContainerDied","Data":"d05807ef8e97fbfd7e3176554481106bbdd300618345af519f18ca87cab918bc"}
Jul 07 16:44:48.089069 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.089066    2573 scope.go:117] "RemoveContainer" containerID="c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831"
Jul 07 16:44:48.097863 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.097841    2573 scope.go:117] "RemoveContainer" containerID="c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831"
Jul 07 16:44:48.098173 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:44:48.098155    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831\": container with ID starting with c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831 not found: ID does not exist" containerID="c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831"
Jul 07 16:44:48.098245 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.098181    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831"} err="failed to get container status \"c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831\": rpc error: code = NotFound desc = could not find container \"c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831\": container with ID starting with c5c8f8831d01f07fe3648f1a2ccf4d865dafa62bde317635416f727c9d731831 not found: ID does not exist"
Jul 07 16:44:48.111764 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.111736    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"]
Jul 07 16:44:48.116050 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.116028    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-3b3b9194-c85b84f89-xp54s"]
Jul 07 16:44:48.164855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.164832    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:44:48.164855 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.164855    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwwzl\" (UniqueName: \"kubernetes.io/projected/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-kube-api-access-wwwzl\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:44:48.165037 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.164870    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76b5bf22-448f-4183-bb6f-0fff9d83ddd0-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:44:48.659106 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:44:48.659071    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b5bf22-448f-4183-bb6f-0fff9d83ddd0" path="/var/lib/kubelet/pods/76b5bf22-448f-4183-bb6f-0fff9d83ddd0/volumes"
Jul 07 16:45:00.159354 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.159320    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724045-dzmzv"]
Jul 07 16:45:00.159769 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.159700    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b5bf22-448f-4183-bb6f-0fff9d83ddd0" containerName="maas-api"
Jul 07 16:45:00.159769 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.159711    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b5bf22-448f-4183-bb6f-0fff9d83ddd0" containerName="maas-api"
Jul 07 16:45:00.159846 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.159787    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b5bf22-448f-4183-bb6f-0fff9d83ddd0" containerName="maas-api"
Jul 07 16:45:00.162972 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.162935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:00.176371 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.176343    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724045-dzmzv"]
Jul 07 16:45:00.274123 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.274020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfrv\" (UniqueName: \"kubernetes.io/projected/6d10cdcc-790d-4627-bfee-3629948ea07c-kube-api-access-jcfrv\") pod \"maas-api-key-cleanup-29724045-dzmzv\" (UID: \"6d10cdcc-790d-4627-bfee-3629948ea07c\") " pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:00.375661 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.375620    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfrv\" (UniqueName: \"kubernetes.io/projected/6d10cdcc-790d-4627-bfee-3629948ea07c-kube-api-access-jcfrv\") pod \"maas-api-key-cleanup-29724045-dzmzv\" (UID: \"6d10cdcc-790d-4627-bfee-3629948ea07c\") " pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:00.384866 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.384837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfrv\" (UniqueName: \"kubernetes.io/projected/6d10cdcc-790d-4627-bfee-3629948ea07c-kube-api-access-jcfrv\") pod \"maas-api-key-cleanup-29724045-dzmzv\" (UID: \"6d10cdcc-790d-4627-bfee-3629948ea07c\") " pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:00.472649 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.472601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:00.838529 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:00.838503    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724045-dzmzv"]
Jul 07 16:45:00.840136 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:45:00.840096    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d10cdcc_790d_4627_bfee_3629948ea07c.slice/crio-4f17f55f4178a372e430d02dcadf663bf511619d1bbba578ae6f552379216814 WatchSource:0}: Error finding container 4f17f55f4178a372e430d02dcadf663bf511619d1bbba578ae6f552379216814: Status 404 returned error can't find the container with id 4f17f55f4178a372e430d02dcadf663bf511619d1bbba578ae6f552379216814
Jul 07 16:45:01.158797 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.158763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv" event={"ID":"6d10cdcc-790d-4627-bfee-3629948ea07c","Type":"ContainerStarted","Data":"616f7856fbe9a93a395df4692343849731aaf3be766c8959bb1a879dbe16cff4"}
Jul 07 16:45:01.158987 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.158820    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv" event={"ID":"6d10cdcc-790d-4627-bfee-3629948ea07c","Type":"ContainerStarted","Data":"4f17f55f4178a372e430d02dcadf663bf511619d1bbba578ae6f552379216814"}
Jul 07 16:45:01.186859 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.186808    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv" podStartSLOduration=1.186790526 podStartE2EDuration="1.186790526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:45:01.185817874 +0000 UTC m=+1601.037432047" watchObservedRunningTime="2026-07-07 16:45:01.186790526 +0000 UTC m=+1601.038404700"
Jul 07 16:45:01.343147 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.343112    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"]
Jul 07 16:45:01.347255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.347239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.353507 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.353484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-0aef4282-serving-cert\""
Jul 07 16:45:01.371193 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.371157    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"]
Jul 07 16:45:01.496095 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.495996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.496095 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.496048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308f0f8e-5196-4d09-940e-823999f36973-openshift-service-ca\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.496310 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.496145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxmrt\" (UniqueName: \"kubernetes.io/projected/308f0f8e-5196-4d09-940e-823999f36973-kube-api-access-qxmrt\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.597373 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.597340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxmrt\" (UniqueName: \"kubernetes.io/projected/308f0f8e-5196-4d09-940e-823999f36973-kube-api-access-qxmrt\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.597562 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.597407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.597562 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.597433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308f0f8e-5196-4d09-940e-823999f36973-openshift-service-ca\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.597637 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:45:01.597560    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-0aef4282-serving-cert: secret "maas-api-e2e-derive-0aef4282-serving-cert" not found
Jul 07 16:45:01.597637 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:45:01.597621    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls podName:308f0f8e-5196-4d09-940e-823999f36973 nodeName:}" failed. No retries permitted until 2026-07-07 16:45:02.097601602 +0000 UTC m=+1601.949215766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls") pod "maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" (UID: "308f0f8e-5196-4d09-940e-823999f36973") : secret "maas-api-e2e-derive-0aef4282-serving-cert" not found
Jul 07 16:45:01.598052 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.598036    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308f0f8e-5196-4d09-940e-823999f36973-openshift-service-ca\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:01.611599 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:01.611575    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxmrt\" (UniqueName: \"kubernetes.io/projected/308f0f8e-5196-4d09-940e-823999f36973-kube-api-access-qxmrt\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:02.102636 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:02.102551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:02.105028 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:02.104996    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls\") pod \"maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") " pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:02.165161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:02.165122    2573 generic.go:356] "Generic (PLEG): container finished" podID="6d10cdcc-790d-4627-bfee-3629948ea07c" containerID="616f7856fbe9a93a395df4692343849731aaf3be766c8959bb1a879dbe16cff4" exitCode=0
Jul 07 16:45:02.165353 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:02.165205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv" event={"ID":"6d10cdcc-790d-4627-bfee-3629948ea07c","Type":"ContainerDied","Data":"616f7856fbe9a93a395df4692343849731aaf3be766c8959bb1a879dbe16cff4"}
Jul 07 16:45:02.258751 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:02.258713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:02.407543 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:02.407512    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"]
Jul 07 16:45:02.409181 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:45:02.409156    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308f0f8e_5196_4d09_940e_823999f36973.slice/crio-53cd38166b204a022ecd748aa7955ff1b3bb530ef7d1019bb72c9ad185686d19 WatchSource:0}: Error finding container 53cd38166b204a022ecd748aa7955ff1b3bb530ef7d1019bb72c9ad185686d19: Status 404 returned error can't find the container with id 53cd38166b204a022ecd748aa7955ff1b3bb530ef7d1019bb72c9ad185686d19
Jul 07 16:45:03.171588 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:03.171550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" event={"ID":"308f0f8e-5196-4d09-940e-823999f36973","Type":"ContainerStarted","Data":"53cd38166b204a022ecd748aa7955ff1b3bb530ef7d1019bb72c9ad185686d19"}
Jul 07 16:45:03.311475 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:03.311451    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:03.419015 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:03.418981    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcfrv\" (UniqueName: \"kubernetes.io/projected/6d10cdcc-790d-4627-bfee-3629948ea07c-kube-api-access-jcfrv\") pod \"6d10cdcc-790d-4627-bfee-3629948ea07c\" (UID: \"6d10cdcc-790d-4627-bfee-3629948ea07c\") "
Jul 07 16:45:03.420917 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:03.420885    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d10cdcc-790d-4627-bfee-3629948ea07c-kube-api-access-jcfrv" (OuterVolumeSpecName: "kube-api-access-jcfrv") pod "6d10cdcc-790d-4627-bfee-3629948ea07c" (UID: "6d10cdcc-790d-4627-bfee-3629948ea07c"). InnerVolumeSpecName "kube-api-access-jcfrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:45:03.520635 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:03.520602    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcfrv\" (UniqueName: \"kubernetes.io/projected/6d10cdcc-790d-4627-bfee-3629948ea07c-kube-api-access-jcfrv\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:45:04.177725 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:04.177698    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv"
Jul 07 16:45:04.177910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:04.177697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724045-dzmzv" event={"ID":"6d10cdcc-790d-4627-bfee-3629948ea07c","Type":"ContainerDied","Data":"4f17f55f4178a372e430d02dcadf663bf511619d1bbba578ae6f552379216814"}
Jul 07 16:45:04.177910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:04.177814    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f17f55f4178a372e430d02dcadf663bf511619d1bbba578ae6f552379216814"
Jul 07 16:45:04.179395 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:04.179369    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" event={"ID":"308f0f8e-5196-4d09-940e-823999f36973","Type":"ContainerStarted","Data":"c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe"}
Jul 07 16:45:04.179498 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:04.179473    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:04.201043 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:04.200992    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" podStartSLOduration=2.501863214 podStartE2EDuration="3.200974987s" totalImagesPullingTime="699.111773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:45:04.199027583 +0000 UTC m=+1604.050641756" watchObservedRunningTime="2026-07-07 16:45:04.200974987 +0000 UTC m=+1604.052589157"
Jul 07 16:45:06.017878 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.017832    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"]
Jul 07 16:45:06.189507 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.189464    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" podUID="308f0f8e-5196-4d09-940e-823999f36973" containerName="maas-api" containerID="cri-o://c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe" gracePeriod=30
Jul 07 16:45:06.436182 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.436156    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:06.546286 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.546256    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls\") pod \"308f0f8e-5196-4d09-940e-823999f36973\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") "
Jul 07 16:45:06.546286 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.546291    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308f0f8e-5196-4d09-940e-823999f36973-openshift-service-ca\") pod \"308f0f8e-5196-4d09-940e-823999f36973\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") "
Jul 07 16:45:06.546490 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.546356    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxmrt\" (UniqueName: \"kubernetes.io/projected/308f0f8e-5196-4d09-940e-823999f36973-kube-api-access-qxmrt\") pod \"308f0f8e-5196-4d09-940e-823999f36973\" (UID: \"308f0f8e-5196-4d09-940e-823999f36973\") "
Jul 07 16:45:06.546674 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.546649    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308f0f8e-5196-4d09-940e-823999f36973-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "308f0f8e-5196-4d09-940e-823999f36973" (UID: "308f0f8e-5196-4d09-940e-823999f36973"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:45:06.548371 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.548346    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "308f0f8e-5196-4d09-940e-823999f36973" (UID: "308f0f8e-5196-4d09-940e-823999f36973"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:45:06.548501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.548478    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308f0f8e-5196-4d09-940e-823999f36973-kube-api-access-qxmrt" (OuterVolumeSpecName: "kube-api-access-qxmrt") pod "308f0f8e-5196-4d09-940e-823999f36973" (UID: "308f0f8e-5196-4d09-940e-823999f36973"). InnerVolumeSpecName "kube-api-access-qxmrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:45:06.647341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.647302    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308f0f8e-5196-4d09-940e-823999f36973-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:45:06.647341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.647334    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308f0f8e-5196-4d09-940e-823999f36973-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:45:06.647341 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:06.647349    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxmrt\" (UniqueName: \"kubernetes.io/projected/308f0f8e-5196-4d09-940e-823999f36973-kube-api-access-qxmrt\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:45:07.201831 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.201792    2573 generic.go:356] "Generic (PLEG): container finished" podID="308f0f8e-5196-4d09-940e-823999f36973" containerID="c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe" exitCode=0
Jul 07 16:45:07.201831 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.201826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" event={"ID":"308f0f8e-5196-4d09-940e-823999f36973","Type":"ContainerDied","Data":"c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe"}
Jul 07 16:45:07.202361 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.201852    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"
Jul 07 16:45:07.202361 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.201902    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f" event={"ID":"308f0f8e-5196-4d09-940e-823999f36973","Type":"ContainerDied","Data":"53cd38166b204a022ecd748aa7955ff1b3bb530ef7d1019bb72c9ad185686d19"}
Jul 07 16:45:07.202361 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.201924    2573 scope.go:117] "RemoveContainer" containerID="c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe"
Jul 07 16:45:07.210561 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.210533    2573 scope.go:117] "RemoveContainer" containerID="c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe"
Jul 07 16:45:07.210839 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:45:07.210819    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe\": container with ID starting with c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe not found: ID does not exist" containerID="c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe"
Jul 07 16:45:07.210896 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.210847    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe"} err="failed to get container status \"c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe\": rpc error: code = NotFound desc = could not find container \"c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe\": container with ID starting with c4a92500c1102e7236a29abd6b0738a3af694a90a6a5c6860478ba06c1b30bbe not found: ID does not exist"
Jul 07 16:45:07.219610 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.219578    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"]
Jul 07 16:45:07.225806 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:07.225783    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-0aef4282-b8ccf7f4c-g2j5f"]
Jul 07 16:45:08.658736 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:45:08.658700    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308f0f8e-5196-4d09-940e-823999f36973" path="/var/lib/kubelet/pods/308f0f8e-5196-4d09-940e-823999f36973/volumes"
Jul 07 16:46:51.841568 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.841531    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"]
Jul 07 16:46:51.842186 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.842167    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d10cdcc-790d-4627-bfee-3629948ea07c" containerName="cleanup"
Jul 07 16:46:51.842239 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.842190    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d10cdcc-790d-4627-bfee-3629948ea07c" containerName="cleanup"
Jul 07 16:46:51.842239 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.842206    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308f0f8e-5196-4d09-940e-823999f36973" containerName="maas-api"
Jul 07 16:46:51.842239 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.842216    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="308f0f8e-5196-4d09-940e-823999f36973" containerName="maas-api"
Jul 07 16:46:51.842333 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.842314    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d10cdcc-790d-4627-bfee-3629948ea07c" containerName="cleanup"
Jul 07 16:46:51.842333 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.842327    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="308f0f8e-5196-4d09-940e-823999f36973" containerName="maas-api"
Jul 07 16:46:51.846053 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.846031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:51.848729 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.848708    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-499e5e07-serving-cert\""
Jul 07 16:46:51.858570 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.858547    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"]
Jul 07 16:46:51.929003 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.928975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:51.929182 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.929084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49803734-de04-4ff5-950d-f0ffb8f10955-openshift-service-ca\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:51.929182 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:51.929126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sj59\" (UniqueName: \"kubernetes.io/projected/49803734-de04-4ff5-950d-f0ffb8f10955-kube-api-access-9sj59\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.029812 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.029779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49803734-de04-4ff5-950d-f0ffb8f10955-openshift-service-ca\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.030010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.029820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sj59\" (UniqueName: \"kubernetes.io/projected/49803734-de04-4ff5-950d-f0ffb8f10955-kube-api-access-9sj59\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.030010 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.029866    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.030113 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:46:52.030013    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-499e5e07-serving-cert: secret "maas-api-e2e-mt-499e5e07-serving-cert" not found
Jul 07 16:46:52.030113 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:46:52.030093    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls podName:49803734-de04-4ff5-950d-f0ffb8f10955 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:52.530075801 +0000 UTC m=+1712.381689952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls") pod "maas-api-e2e-mt-499e5e07-98c864879-l7fb6" (UID: "49803734-de04-4ff5-950d-f0ffb8f10955") : secret "maas-api-e2e-mt-499e5e07-serving-cert" not found
Jul 07 16:46:52.030521 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.030502    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49803734-de04-4ff5-950d-f0ffb8f10955-openshift-service-ca\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.044720 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.044689    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sj59\" (UniqueName: \"kubernetes.io/projected/49803734-de04-4ff5-950d-f0ffb8f10955-kube-api-access-9sj59\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.534439 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.534401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.536983 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.536941    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls\") pod \"maas-api-e2e-mt-499e5e07-98c864879-l7fb6\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") " pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.756805 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.756769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:52.893464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:52.893441    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"]
Jul 07 16:46:52.895276 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:46:52.895249    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49803734_de04_4ff5_950d_f0ffb8f10955.slice/crio-fb46628b9f3397b30c722718f6bcc52d4ff8e3dad61c041325101c820b5563ff WatchSource:0}: Error finding container fb46628b9f3397b30c722718f6bcc52d4ff8e3dad61c041325101c820b5563ff: Status 404 returned error can't find the container with id fb46628b9f3397b30c722718f6bcc52d4ff8e3dad61c041325101c820b5563ff
Jul 07 16:46:53.719708 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:53.719671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6" event={"ID":"49803734-de04-4ff5-950d-f0ffb8f10955","Type":"ContainerStarted","Data":"d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26"}
Jul 07 16:46:53.719905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:53.719728    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6" event={"ID":"49803734-de04-4ff5-950d-f0ffb8f10955","Type":"ContainerStarted","Data":"fb46628b9f3397b30c722718f6bcc52d4ff8e3dad61c041325101c820b5563ff"}
Jul 07 16:46:53.719905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:53.719774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:46:53.738248 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:53.738192    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6" podStartSLOduration=2.338547646 podStartE2EDuration="2.738177357s" totalImagesPullingTime="399.629711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:53.73711602 +0000 UTC m=+1713.588730192" watchObservedRunningTime="2026-07-07 16:46:53.738177357 +0000 UTC m=+1713.589791560"
Jul 07 16:46:59.729372 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:46:59.729346    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:47:04.167570 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.167533    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"]
Jul 07 16:47:04.168071 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.167726    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6" podUID="49803734-de04-4ff5-950d-f0ffb8f10955" containerName="maas-api" containerID="cri-o://d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26" gracePeriod=30
Jul 07 16:47:04.412388 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.412360    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:47:04.548552 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.548446    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sj59\" (UniqueName: \"kubernetes.io/projected/49803734-de04-4ff5-950d-f0ffb8f10955-kube-api-access-9sj59\") pod \"49803734-de04-4ff5-950d-f0ffb8f10955\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") "
Jul 07 16:47:04.548552 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.548546    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49803734-de04-4ff5-950d-f0ffb8f10955-openshift-service-ca\") pod \"49803734-de04-4ff5-950d-f0ffb8f10955\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") "
Jul 07 16:47:04.548768 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.548572    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls\") pod \"49803734-de04-4ff5-950d-f0ffb8f10955\" (UID: \"49803734-de04-4ff5-950d-f0ffb8f10955\") "
Jul 07 16:47:04.548909 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.548882    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49803734-de04-4ff5-950d-f0ffb8f10955-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "49803734-de04-4ff5-950d-f0ffb8f10955" (UID: "49803734-de04-4ff5-950d-f0ffb8f10955"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:47:04.550609 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.550586    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49803734-de04-4ff5-950d-f0ffb8f10955-kube-api-access-9sj59" (OuterVolumeSpecName: "kube-api-access-9sj59") pod "49803734-de04-4ff5-950d-f0ffb8f10955" (UID: "49803734-de04-4ff5-950d-f0ffb8f10955"). InnerVolumeSpecName "kube-api-access-9sj59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:47:04.550683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.550628    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "49803734-de04-4ff5-950d-f0ffb8f10955" (UID: "49803734-de04-4ff5-950d-f0ffb8f10955"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:47:04.649428 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.649379    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49803734-de04-4ff5-950d-f0ffb8f10955-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:47:04.649428 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.649421    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49803734-de04-4ff5-950d-f0ffb8f10955-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:47:04.649428 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.649432    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sj59\" (UniqueName: \"kubernetes.io/projected/49803734-de04-4ff5-950d-f0ffb8f10955-kube-api-access-9sj59\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:47:04.771650 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.771616    2573 generic.go:356] "Generic (PLEG): container finished" podID="49803734-de04-4ff5-950d-f0ffb8f10955" containerID="d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26" exitCode=0
Jul 07 16:47:04.771821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.771665    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"
Jul 07 16:47:04.771821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.771700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6" event={"ID":"49803734-de04-4ff5-950d-f0ffb8f10955","Type":"ContainerDied","Data":"d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26"}
Jul 07 16:47:04.771821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.771759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6" event={"ID":"49803734-de04-4ff5-950d-f0ffb8f10955","Type":"ContainerDied","Data":"fb46628b9f3397b30c722718f6bcc52d4ff8e3dad61c041325101c820b5563ff"}
Jul 07 16:47:04.771821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.771789    2573 scope.go:117] "RemoveContainer" containerID="d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26"
Jul 07 16:47:04.780682 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.780664    2573 scope.go:117] "RemoveContainer" containerID="d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26"
Jul 07 16:47:04.780976 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:47:04.780940    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26\": container with ID starting with d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26 not found: ID does not exist" containerID="d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26"
Jul 07 16:47:04.781080 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.780985    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26"} err="failed to get container status \"d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26\": rpc error: code = NotFound desc = could not find container \"d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26\": container with ID starting with d681bc0014d1c770dd6c174ade59347c9ec102161de90511adf8561d8dd88b26 not found: ID does not exist"
Jul 07 16:47:04.790967 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.790921    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"]
Jul 07 16:47:04.793091 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:04.793068    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-499e5e07-98c864879-l7fb6"]
Jul 07 16:47:06.659013 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:06.658976    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49803734-de04-4ff5-950d-f0ffb8f10955" path="/var/lib/kubelet/pods/49803734-de04-4ff5-950d-f0ffb8f10955/volumes"
Jul 07 16:47:33.348057 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.348024    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"]
Jul 07 16:47:33.348635 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.348620    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49803734-de04-4ff5-950d-f0ffb8f10955" containerName="maas-api"
Jul 07 16:47:33.348682 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.348639    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="49803734-de04-4ff5-950d-f0ffb8f10955" containerName="maas-api"
Jul 07 16:47:33.348740 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.348729    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="49803734-de04-4ff5-950d-f0ffb8f10955" containerName="maas-api"
Jul 07 16:47:33.352270 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.352250    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.356795 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.356770    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-15de1b1f-serving-cert\""
Jul 07 16:47:33.364255 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.364233    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"]
Jul 07 16:47:33.408331 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.408303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-openshift-service-ca\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.408464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.408343    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.408464 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.408437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnhqm\" (UniqueName: \"kubernetes.io/projected/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-kube-api-access-hnhqm\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.509167 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.509136    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-openshift-service-ca\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.509324 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.509176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.509324 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.509223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnhqm\" (UniqueName: \"kubernetes.io/projected/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-kube-api-access-hnhqm\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.509399 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:47:33.509347    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-15de1b1f-serving-cert: secret "maas-api-e2e-mt-15de1b1f-serving-cert" not found
Jul 07 16:47:33.509442 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:47:33.509418    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls podName:73e3c2b9-1453-45f7-9fc3-cc02e116b07b nodeName:}" failed. No retries permitted until 2026-07-07 16:47:34.009401435 +0000 UTC m=+1753.861015590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls") pod "maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" (UID: "73e3c2b9-1453-45f7-9fc3-cc02e116b07b") : secret "maas-api-e2e-mt-15de1b1f-serving-cert" not found
Jul 07 16:47:33.509751 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.509733    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-openshift-service-ca\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:33.519513 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:33.519492    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnhqm\" (UniqueName: \"kubernetes.io/projected/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-kube-api-access-hnhqm\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:34.013912 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.013877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:34.016224 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.016202    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls\") pod \"maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") " pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:34.264469 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.264390    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:34.399287 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.399263    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"]
Jul 07 16:47:34.401432 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:47:34.401392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e3c2b9_1453_45f7_9fc3_cc02e116b07b.slice/crio-b63e95f79df531f7ff180b8171f89d59c319a0b1871772d2a7bcf0b4bec480a0 WatchSource:0}: Error finding container b63e95f79df531f7ff180b8171f89d59c319a0b1871772d2a7bcf0b4bec480a0: Status 404 returned error can't find the container with id b63e95f79df531f7ff180b8171f89d59c319a0b1871772d2a7bcf0b4bec480a0
Jul 07 16:47:34.917286 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.917250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" event={"ID":"73e3c2b9-1453-45f7-9fc3-cc02e116b07b","Type":"ContainerStarted","Data":"62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f"}
Jul 07 16:47:34.917477 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.917312    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:47:34.917477 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.917329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" event={"ID":"73e3c2b9-1453-45f7-9fc3-cc02e116b07b","Type":"ContainerStarted","Data":"b63e95f79df531f7ff180b8171f89d59c319a0b1871772d2a7bcf0b4bec480a0"}
Jul 07 16:47:34.951420 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:34.951368    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" podStartSLOduration=1.602420986 podStartE2EDuration="1.95135146s" totalImagesPullingTime="348.930474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:34.948589533 +0000 UTC m=+1754.800203731" watchObservedRunningTime="2026-07-07 16:47:34.95135146 +0000 UTC m=+1754.802965633"
Jul 07 16:47:40.928181 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:47:40.928151    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:48:10.513542 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.513509    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"]
Jul 07 16:48:10.514162 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.513776    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" podUID="73e3c2b9-1453-45f7-9fc3-cc02e116b07b" containerName="maas-api" containerID="cri-o://62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f" gracePeriod=30
Jul 07 16:48:10.773429 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.773370    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:48:10.858698 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.858664    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-openshift-service-ca\") pod \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") "
Jul 07 16:48:10.858698 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.858699    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnhqm\" (UniqueName: \"kubernetes.io/projected/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-kube-api-access-hnhqm\") pod \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") "
Jul 07 16:48:10.858932 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.858771    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls\") pod \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\" (UID: \"73e3c2b9-1453-45f7-9fc3-cc02e116b07b\") "
Jul 07 16:48:10.859044 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.859022    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73e3c2b9-1453-45f7-9fc3-cc02e116b07b" (UID: "73e3c2b9-1453-45f7-9fc3-cc02e116b07b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:48:10.860916 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.860888    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-kube-api-access-hnhqm" (OuterVolumeSpecName: "kube-api-access-hnhqm") pod "73e3c2b9-1453-45f7-9fc3-cc02e116b07b" (UID: "73e3c2b9-1453-45f7-9fc3-cc02e116b07b"). InnerVolumeSpecName "kube-api-access-hnhqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:48:10.861089 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.860921    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73e3c2b9-1453-45f7-9fc3-cc02e116b07b" (UID: "73e3c2b9-1453-45f7-9fc3-cc02e116b07b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:48:10.959771 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.959736    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:48:10.959771 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.959765    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnhqm\" (UniqueName: \"kubernetes.io/projected/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-kube-api-access-hnhqm\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:48:10.959771 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:10.959776    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73e3c2b9-1453-45f7-9fc3-cc02e116b07b-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:48:11.093065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.092939    2573 generic.go:356] "Generic (PLEG): container finished" podID="73e3c2b9-1453-45f7-9fc3-cc02e116b07b" containerID="62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f" exitCode=0
Jul 07 16:48:11.093065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.092994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" event={"ID":"73e3c2b9-1453-45f7-9fc3-cc02e116b07b","Type":"ContainerDied","Data":"62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f"}
Jul 07 16:48:11.093065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.093012    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"
Jul 07 16:48:11.093065 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.093054    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n" event={"ID":"73e3c2b9-1453-45f7-9fc3-cc02e116b07b","Type":"ContainerDied","Data":"b63e95f79df531f7ff180b8171f89d59c319a0b1871772d2a7bcf0b4bec480a0"}
Jul 07 16:48:11.093378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.093078    2573 scope.go:117] "RemoveContainer" containerID="62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f"
Jul 07 16:48:11.102295 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.102276    2573 scope.go:117] "RemoveContainer" containerID="62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f"
Jul 07 16:48:11.102576 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:48:11.102559    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f\": container with ID starting with 62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f not found: ID does not exist" containerID="62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f"
Jul 07 16:48:11.102628 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.102584    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f"} err="failed to get container status \"62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f\": rpc error: code = NotFound desc = could not find container \"62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f\": container with ID starting with 62ca1181c24934915bf5219dc51d3292ca359dc0b441b7de7ca017378720586f not found: ID does not exist"
Jul 07 16:48:11.115635 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.115608    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"]
Jul 07 16:48:11.119211 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:11.119188    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-15de1b1f-765ffd59b6-87h7n"]
Jul 07 16:48:12.659312 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:12.659277    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73e3c2b9-1453-45f7-9fc3-cc02e116b07b" path="/var/lib/kubelet/pods/73e3c2b9-1453-45f7-9fc3-cc02e116b07b/volumes"
Jul 07 16:48:20.742358 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:20.742251    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:48:20.749907 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:20.748699    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:48:20.749907 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:20.749427    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:48:20.753059 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:48:20.753038    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:50:05.350559 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.350524    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"]
Jul 07 16:50:05.351028 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.350910    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e3c2b9-1453-45f7-9fc3-cc02e116b07b" containerName="maas-api"
Jul 07 16:50:05.351028 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.350922    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e3c2b9-1453-45f7-9fc3-cc02e116b07b" containerName="maas-api"
Jul 07 16:50:05.351112 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.351032    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e3c2b9-1453-45f7-9fc3-cc02e116b07b" containerName="maas-api"
Jul 07 16:50:05.354178 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.354161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.362067 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.362045    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-592405-serving-cert\""
Jul 07 16:50:05.372174 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.372149    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"]
Jul 07 16:50:05.401418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.401381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd607b5f-3aa1-448a-adc6-74479ab298e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.401418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.401413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2gp4\" (UniqueName: \"kubernetes.io/projected/fd607b5f-3aa1-448a-adc6-74479ab298e9-kube-api-access-s2gp4\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.401611 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.401438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd607b5f-3aa1-448a-adc6-74479ab298e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.502083 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.502044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd607b5f-3aa1-448a-adc6-74479ab298e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.502083 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.502084    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2gp4\" (UniqueName: \"kubernetes.io/projected/fd607b5f-3aa1-448a-adc6-74479ab298e9-kube-api-access-s2gp4\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.502355 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.502124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd607b5f-3aa1-448a-adc6-74479ab298e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.502774 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.502748    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd607b5f-3aa1-448a-adc6-74479ab298e9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.504465 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.504445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd607b5f-3aa1-448a-adc6-74479ab298e9-maas-api-tls\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.532373 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.532348    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2gp4\" (UniqueName: \"kubernetes.io/projected/fd607b5f-3aa1-448a-adc6-74479ab298e9-kube-api-access-s2gp4\") pod \"maas-api-e2e-inf-a-592405-64544b6d9d-5dt47\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") " pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.665081 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.665050    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:05.830044 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.829442    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"]
Jul 07 16:50:05.834154 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:05.834129    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:50:06.659507 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:06.659466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47" event={"ID":"fd607b5f-3aa1-448a-adc6-74479ab298e9","Type":"ContainerStarted","Data":"7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8"}
Jul 07 16:50:06.659862 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:06.659522    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:06.659862 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:06.659539    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47" event={"ID":"fd607b5f-3aa1-448a-adc6-74479ab298e9","Type":"ContainerStarted","Data":"12e5de567a4b024307d04503b13d01f22d9e4321908b0c01176be874d32e327e"}
Jul 07 16:50:06.753841 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:06.753747    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47" podStartSLOduration=1.138177816 podStartE2EDuration="1.753731328s" totalImagesPullingTime="615.553512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:06.748382045 +0000 UTC m=+1906.599996218" watchObservedRunningTime="2026-07-07 16:50:06.753731328 +0000 UTC m=+1906.605345574"
Jul 07 16:50:12.668833 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:12.668799    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:50:13.194017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.193972    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"]
Jul 07 16:50:13.197919 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.197894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.202711 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.202686    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-cfae17-serving-cert\""
Jul 07 16:50:13.217935 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.217909    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"]
Jul 07 16:50:13.278628 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.278603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27xg\" (UniqueName: \"kubernetes.io/projected/226547da-c8b5-4b65-910d-2a3c4c2e20f7-kube-api-access-z27xg\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.278780 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.278653    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.278780 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.278691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226547da-c8b5-4b65-910d-2a3c4c2e20f7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.379296 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.379266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27xg\" (UniqueName: \"kubernetes.io/projected/226547da-c8b5-4b65-910d-2a3c4c2e20f7-kube-api-access-z27xg\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.379446 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.379320    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.379446 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.379350    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226547da-c8b5-4b65-910d-2a3c4c2e20f7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.379542 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:50:13.379464    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-cfae17-serving-cert: secret "maas-api-e2e-inf-b-cfae17-serving-cert" not found
Jul 07 16:50:13.379542 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:50:13.379534    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls podName:226547da-c8b5-4b65-910d-2a3c4c2e20f7 nodeName:}" failed. No retries permitted until 2026-07-07 16:50:13.879515166 +0000 UTC m=+1913.731129321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls") pod "maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" (UID: "226547da-c8b5-4b65-910d-2a3c4c2e20f7") : secret "maas-api-e2e-inf-b-cfae17-serving-cert" not found
Jul 07 16:50:13.379934 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.379918    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226547da-c8b5-4b65-910d-2a3c4c2e20f7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.390602 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.390568    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27xg\" (UniqueName: \"kubernetes.io/projected/226547da-c8b5-4b65-910d-2a3c4c2e20f7-kube-api-access-z27xg\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.883358 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.883325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:13.885501 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:13.885482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-cfae17-59b696f647-w94z6\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") " pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:14.109851 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:14.109822    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:14.253559 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:14.253534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"]
Jul 07 16:50:14.255702 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:50:14.255677    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226547da_c8b5_4b65_910d_2a3c4c2e20f7.slice/crio-95c104dce7c0d6ea9e5f0d1f89f6135d11ecc5ace41280fc3ca496b33193da56 WatchSource:0}: Error finding container 95c104dce7c0d6ea9e5f0d1f89f6135d11ecc5ace41280fc3ca496b33193da56: Status 404 returned error can't find the container with id 95c104dce7c0d6ea9e5f0d1f89f6135d11ecc5ace41280fc3ca496b33193da56
Jul 07 16:50:14.697662 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:14.697634    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" event={"ID":"226547da-c8b5-4b65-910d-2a3c4c2e20f7","Type":"ContainerStarted","Data":"58d0b75c98a584dfa9c51a7a201ef1c33948d116bea8f9abaf0f88ed44a32daf"}
Jul 07 16:50:14.697787 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:14.697691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" event={"ID":"226547da-c8b5-4b65-910d-2a3c4c2e20f7","Type":"ContainerStarted","Data":"95c104dce7c0d6ea9e5f0d1f89f6135d11ecc5ace41280fc3ca496b33193da56"}
Jul 07 16:50:14.697787 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:14.697725    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:14.718864 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:14.718812    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" podStartSLOduration=1.382824048 podStartE2EDuration="1.718794142s" totalImagesPullingTime="335.970094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:14.717837834 +0000 UTC m=+1914.569452006" watchObservedRunningTime="2026-07-07 16:50:14.718794142 +0000 UTC m=+1914.570408318"
Jul 07 16:50:20.708737 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:20.708706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:50:23.356720 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.356682    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"]
Jul 07 16:50:23.360446 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.360425    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.364507 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.364482    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-592405\"/\"openshift-service-ca.crt\""
Jul 07 16:50:23.364507 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.364485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-592405\"/\"test-model-592405-kserve-self-signed-certs\""
Jul 07 16:50:23.364668 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.364489    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-592405\"/\"kube-root-ca.crt\""
Jul 07 16:50:23.364668 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.364542    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-592405\"/\"default-dockercfg-9zxh7\""
Jul 07 16:50:23.373910 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.373889    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"]
Jul 07 16:50:23.467830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.467799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-home\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.467830 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.467830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tls-certs\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.468049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.467864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxztb\" (UniqueName: \"kubernetes.io/projected/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-kube-api-access-gxztb\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.468049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.467979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tmp-dir\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.468049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.468004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-dshm\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.468049 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.468028    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-model-cache\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.568628 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.568598    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-home\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.568628 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.568627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tls-certs\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.568873 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.568672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxztb\" (UniqueName: \"kubernetes.io/projected/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-kube-api-access-gxztb\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.568873 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.568704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tmp-dir\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.568873 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.568719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-dshm\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.568873 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.568741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-model-cache\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.569112 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.569094    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-home\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.569184 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.569110    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tmp-dir\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.569242 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.569190    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-model-cache\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.570919 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.570888    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-dshm\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.571272 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.571255    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tls-certs\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.577865 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.577841    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxztb\" (UniqueName: \"kubernetes.io/projected/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-kube-api-access-gxztb\") pod \"test-model-592405-kserve-5896486b7-k5cc8\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") " pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.669495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.669469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:23.808426 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:23.808397    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"]
Jul 07 16:50:23.811754 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:50:23.811730    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd9cf40a_7bcb_4d26_9c1a_0863d9c4a9f0.slice/crio-bc365c10ea6d835cc5c1f2211e6f7cae86d82bfccdd4fb49ca1b5c10356077c2 WatchSource:0}: Error finding container bc365c10ea6d835cc5c1f2211e6f7cae86d82bfccdd4fb49ca1b5c10356077c2: Status 404 returned error can't find the container with id bc365c10ea6d835cc5c1f2211e6f7cae86d82bfccdd4fb49ca1b5c10356077c2
Jul 07 16:50:24.747551 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:24.747514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8" event={"ID":"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0","Type":"ContainerStarted","Data":"2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e"}
Jul 07 16:50:24.747885 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:24.747564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8" event={"ID":"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0","Type":"ContainerStarted","Data":"bc365c10ea6d835cc5c1f2211e6f7cae86d82bfccdd4fb49ca1b5c10356077c2"}
Jul 07 16:50:24.766397 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:24.766356    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8" podStartSLOduration=1.7663423470000001 podStartE2EDuration="1.766342347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:24.766002977 +0000 UTC m=+1924.617617147" watchObservedRunningTime="2026-07-07 16:50:24.766342347 +0000 UTC m=+1924.617956521"
Jul 07 16:50:33.670048 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:33.670015    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:33.670048 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:33.670060    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:33.682590 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:33.682567    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:50:33.804370 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:50:33.804340    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:51:16.159422 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:16.159340    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"]
Jul 07 16:51:18.284259 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.284224    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"]
Jul 07 16:51:18.284712 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.284464    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47" podUID="fd607b5f-3aa1-448a-adc6-74479ab298e9" containerName="maas-api" containerID="cri-o://7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8" gracePeriod=30
Jul 07 16:51:18.549749 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.549682    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:51:18.610249 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.610218    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd607b5f-3aa1-448a-adc6-74479ab298e9-openshift-service-ca\") pod \"fd607b5f-3aa1-448a-adc6-74479ab298e9\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") "
Jul 07 16:51:18.610416 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.610309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd607b5f-3aa1-448a-adc6-74479ab298e9-maas-api-tls\") pod \"fd607b5f-3aa1-448a-adc6-74479ab298e9\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") "
Jul 07 16:51:18.610416 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.610348    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2gp4\" (UniqueName: \"kubernetes.io/projected/fd607b5f-3aa1-448a-adc6-74479ab298e9-kube-api-access-s2gp4\") pod \"fd607b5f-3aa1-448a-adc6-74479ab298e9\" (UID: \"fd607b5f-3aa1-448a-adc6-74479ab298e9\") "
Jul 07 16:51:18.610416 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.610408    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd607b5f-3aa1-448a-adc6-74479ab298e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fd607b5f-3aa1-448a-adc6-74479ab298e9" (UID: "fd607b5f-3aa1-448a-adc6-74479ab298e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:51:18.610608 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.610587    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd607b5f-3aa1-448a-adc6-74479ab298e9-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:18.612444 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.612421    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd607b5f-3aa1-448a-adc6-74479ab298e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fd607b5f-3aa1-448a-adc6-74479ab298e9" (UID: "fd607b5f-3aa1-448a-adc6-74479ab298e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:51:18.612550 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.612513    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd607b5f-3aa1-448a-adc6-74479ab298e9-kube-api-access-s2gp4" (OuterVolumeSpecName: "kube-api-access-s2gp4") pod "fd607b5f-3aa1-448a-adc6-74479ab298e9" (UID: "fd607b5f-3aa1-448a-adc6-74479ab298e9"). InnerVolumeSpecName "kube-api-access-s2gp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:51:18.712097 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.712063    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd607b5f-3aa1-448a-adc6-74479ab298e9-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:18.712097 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:18.712091    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2gp4\" (UniqueName: \"kubernetes.io/projected/fd607b5f-3aa1-448a-adc6-74479ab298e9-kube-api-access-s2gp4\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:19.026618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.026582    2573 generic.go:356] "Generic (PLEG): container finished" podID="fd607b5f-3aa1-448a-adc6-74479ab298e9" containerID="7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8" exitCode=0
Jul 07 16:51:19.026618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.026621    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47" event={"ID":"fd607b5f-3aa1-448a-adc6-74479ab298e9","Type":"ContainerDied","Data":"7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8"}
Jul 07 16:51:19.026865 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.026628    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"
Jul 07 16:51:19.026865 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.026662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47" event={"ID":"fd607b5f-3aa1-448a-adc6-74479ab298e9","Type":"ContainerDied","Data":"12e5de567a4b024307d04503b13d01f22d9e4321908b0c01176be874d32e327e"}
Jul 07 16:51:19.026865 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.026684    2573 scope.go:117] "RemoveContainer" containerID="7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8"
Jul 07 16:51:19.036237 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.036225    2573 scope.go:117] "RemoveContainer" containerID="7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8"
Jul 07 16:51:19.036501 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:51:19.036481    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8\": container with ID starting with 7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8 not found: ID does not exist" containerID="7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8"
Jul 07 16:51:19.036571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.036518    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8"} err="failed to get container status \"7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8\": rpc error: code = NotFound desc = could not find container \"7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8\": container with ID starting with 7ea20d2f29558a6248a74500a4546c3644934b2e75f8451c3da4a7508b1c3fe8 not found: ID does not exist"
Jul 07 16:51:19.044398 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.044371    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"]
Jul 07 16:51:19.048225 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:19.048203    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-592405-64544b6d9d-5dt47"]
Jul 07 16:51:20.659307 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:20.659277    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd607b5f-3aa1-448a-adc6-74479ab298e9" path="/var/lib/kubelet/pods/fd607b5f-3aa1-448a-adc6-74479ab298e9/volumes"
Jul 07 16:51:31.179989 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.179914    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8" podUID="cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" containerName="main" containerID="cri-o://2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e" gracePeriod=45
Jul 07 16:51:31.429131 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.429099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:51:31.537616 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537519    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxztb\" (UniqueName: \"kubernetes.io/projected/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-kube-api-access-gxztb\") pod \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") "
Jul 07 16:51:31.537616 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537577    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tmp-dir\") pod \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") "
Jul 07 16:51:31.537616 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537616    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-home\") pod \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") "
Jul 07 16:51:31.537905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537653    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tls-certs\") pod \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") "
Jul 07 16:51:31.537905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537767    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-dshm\") pod \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") "
Jul 07 16:51:31.537905 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537827    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-model-cache\") pod \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\" (UID: \"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0\") "
Jul 07 16:51:31.538107 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537934    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-home" (OuterVolumeSpecName: "home") pod "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" (UID: "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:31.538107 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.537944    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" (UID: "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:31.538214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.538144    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" (UID: "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:31.538214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.538181    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-home\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:31.538214 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.538202    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tmp-dir\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:31.539914 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.539885    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-dshm" (OuterVolumeSpecName: "dshm") pod "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" (UID: "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:31.540005 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.539907    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-kube-api-access-gxztb" (OuterVolumeSpecName: "kube-api-access-gxztb") pod "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" (UID: "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0"). InnerVolumeSpecName "kube-api-access-gxztb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:51:31.540005 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.539885    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" (UID: "cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:51:31.639006 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.638940    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-tls-certs\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:31.639006 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.639007    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-dshm\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:31.639230 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.639019    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-model-cache\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:31.639230 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:31.639032    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxztb\" (UniqueName: \"kubernetes.io/projected/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0-kube-api-access-gxztb\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:51:32.100693 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.100661    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" containerID="2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e" exitCode=0
Jul 07 16:51:32.100876 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.100702    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"
Jul 07 16:51:32.100876 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.100738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8" event={"ID":"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0","Type":"ContainerDied","Data":"2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e"}
Jul 07 16:51:32.100876 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.100778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8" event={"ID":"cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0","Type":"ContainerDied","Data":"bc365c10ea6d835cc5c1f2211e6f7cae86d82bfccdd4fb49ca1b5c10356077c2"}
Jul 07 16:51:32.100876 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.100794    2573 scope.go:117] "RemoveContainer" containerID="2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e"
Jul 07 16:51:32.109811 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.109792    2573 scope.go:117] "RemoveContainer" containerID="2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e"
Jul 07 16:51:32.110099 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:51:32.110083    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e\": container with ID starting with 2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e not found: ID does not exist" containerID="2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e"
Jul 07 16:51:32.110154 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.110108    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e"} err="failed to get container status \"2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e\": rpc error: code = NotFound desc = could not find container \"2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e\": container with ID starting with 2029ca192be5ddc8aaa9232e3f2788a32a7ba21f6cfe929faa392f5d8932c42e not found: ID does not exist"
Jul 07 16:51:32.127751 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.127725    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"]
Jul 07 16:51:32.130440 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.130414    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-592405/test-model-592405-kserve-5896486b7-k5cc8"]
Jul 07 16:51:32.660216 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:51:32.660178    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" path="/var/lib/kubelet/pods/cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0/volumes"
Jul 07 16:52:02.101306 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.101265    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"]
Jul 07 16:52:02.101780 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.101559    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" podUID="226547da-c8b5-4b65-910d-2a3c4c2e20f7" containerName="maas-api" containerID="cri-o://58d0b75c98a584dfa9c51a7a201ef1c33948d116bea8f9abaf0f88ed44a32daf" gracePeriod=30
Jul 07 16:52:02.248428 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.248395    2573 generic.go:356] "Generic (PLEG): container finished" podID="226547da-c8b5-4b65-910d-2a3c4c2e20f7" containerID="58d0b75c98a584dfa9c51a7a201ef1c33948d116bea8f9abaf0f88ed44a32daf" exitCode=0
Jul 07 16:52:02.248643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.248475    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" event={"ID":"226547da-c8b5-4b65-910d-2a3c4c2e20f7","Type":"ContainerDied","Data":"58d0b75c98a584dfa9c51a7a201ef1c33948d116bea8f9abaf0f88ed44a32daf"}
Jul 07 16:52:02.351861 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.351797    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:52:02.439083 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.439050    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls\") pod \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") "
Jul 07 16:52:02.439278 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.439112    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226547da-c8b5-4b65-910d-2a3c4c2e20f7-openshift-service-ca\") pod \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") "
Jul 07 16:52:02.439278 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.439150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z27xg\" (UniqueName: \"kubernetes.io/projected/226547da-c8b5-4b65-910d-2a3c4c2e20f7-kube-api-access-z27xg\") pod \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\" (UID: \"226547da-c8b5-4b65-910d-2a3c4c2e20f7\") "
Jul 07 16:52:02.439524 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.439497    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226547da-c8b5-4b65-910d-2a3c4c2e20f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "226547da-c8b5-4b65-910d-2a3c4c2e20f7" (UID: "226547da-c8b5-4b65-910d-2a3c4c2e20f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:02.441132 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.441105    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "226547da-c8b5-4b65-910d-2a3c4c2e20f7" (UID: "226547da-c8b5-4b65-910d-2a3c4c2e20f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:52:02.441276 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.441257    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226547da-c8b5-4b65-910d-2a3c4c2e20f7-kube-api-access-z27xg" (OuterVolumeSpecName: "kube-api-access-z27xg") pod "226547da-c8b5-4b65-910d-2a3c4c2e20f7" (UID: "226547da-c8b5-4b65-910d-2a3c4c2e20f7"). InnerVolumeSpecName "kube-api-access-z27xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:02.540738 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.540697    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/226547da-c8b5-4b65-910d-2a3c4c2e20f7-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:02.540738 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.540730    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/226547da-c8b5-4b65-910d-2a3c4c2e20f7-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:02.540738 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:02.540739    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z27xg\" (UniqueName: \"kubernetes.io/projected/226547da-c8b5-4b65-910d-2a3c4c2e20f7-kube-api-access-z27xg\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:03.254799 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:03.254772    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"
Jul 07 16:52:03.254799 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:03.254789    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6" event={"ID":"226547da-c8b5-4b65-910d-2a3c4c2e20f7","Type":"ContainerDied","Data":"95c104dce7c0d6ea9e5f0d1f89f6135d11ecc5ace41280fc3ca496b33193da56"}
Jul 07 16:52:03.255311 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:03.254844    2573 scope.go:117] "RemoveContainer" containerID="58d0b75c98a584dfa9c51a7a201ef1c33948d116bea8f9abaf0f88ed44a32daf"
Jul 07 16:52:03.281543 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:03.281516    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"]
Jul 07 16:52:03.285483 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:03.285459    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cfae17-59b696f647-w94z6"]
Jul 07 16:52:04.659656 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:04.659621    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226547da-c8b5-4b65-910d-2a3c4c2e20f7" path="/var/lib/kubelet/pods/226547da-c8b5-4b65-910d-2a3c4c2e20f7/volumes"
Jul 07 16:52:12.738020 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.737989    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"]
Jul 07 16:52:12.738396 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738383    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd607b5f-3aa1-448a-adc6-74479ab298e9" containerName="maas-api"
Jul 07 16:52:12.738441 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738397    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd607b5f-3aa1-448a-adc6-74479ab298e9" containerName="maas-api"
Jul 07 16:52:12.738441 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738420    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" containerName="main"
Jul 07 16:52:12.738441 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738425    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" containerName="main"
Jul 07 16:52:12.738534 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738441    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226547da-c8b5-4b65-910d-2a3c4c2e20f7" containerName="maas-api"
Jul 07 16:52:12.738534 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738448    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="226547da-c8b5-4b65-910d-2a3c4c2e20f7" containerName="maas-api"
Jul 07 16:52:12.738534 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738520    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9cf40a-7bcb-4d26-9c1a-0863d9c4a9f0" containerName="main"
Jul 07 16:52:12.738534 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738528    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd607b5f-3aa1-448a-adc6-74479ab298e9" containerName="maas-api"
Jul 07 16:52:12.738661 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.738536    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="226547da-c8b5-4b65-910d-2a3c4c2e20f7" containerName="maas-api"
Jul 07 16:52:12.742819 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.742799    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.752017 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.751998    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-6a9526-serving-cert\""
Jul 07 16:52:12.760788 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.760765    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"]
Jul 07 16:52:12.834732 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.834697    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44d9\" (UniqueName: \"kubernetes.io/projected/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-kube-api-access-h44d9\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.834925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.834749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-maas-api-tls\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.834925 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.834834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-openshift-service-ca\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.936312 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.936281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-maas-api-tls\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.936512 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.936339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-openshift-service-ca\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.936512 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.936397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44d9\" (UniqueName: \"kubernetes.io/projected/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-kube-api-access-h44d9\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.936994 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.936971    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-openshift-service-ca\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.938802 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.938781    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-maas-api-tls\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:12.948260 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:12.948238    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44d9\" (UniqueName: \"kubernetes.io/projected/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-kube-api-access-h44d9\") pod \"maas-api-e2e-api-a-6a9526-684d54b957-7cclj\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") " pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:13.053224 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:13.053134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:13.225096 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:13.225073    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"]
Jul 07 16:52:13.227577 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:52:13.227549    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28d9e24_5e74_429a_9aa1_086cd6d5b0ac.slice/crio-a7061d035d697d164def35e39e7613d520616eec27b601e0f3b56fb2d5ec7b4d WatchSource:0}: Error finding container a7061d035d697d164def35e39e7613d520616eec27b601e0f3b56fb2d5ec7b4d: Status 404 returned error can't find the container with id a7061d035d697d164def35e39e7613d520616eec27b601e0f3b56fb2d5ec7b4d
Jul 07 16:52:13.312081 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:13.311988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj" event={"ID":"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac","Type":"ContainerStarted","Data":"a7061d035d697d164def35e39e7613d520616eec27b601e0f3b56fb2d5ec7b4d"}
Jul 07 16:52:14.318245 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:14.318208    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj" event={"ID":"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac","Type":"ContainerStarted","Data":"ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700"}
Jul 07 16:52:14.318635 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:14.318408    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:14.369979 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:14.369891    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj" podStartSLOduration=1.992353884 podStartE2EDuration="2.369875685s" totalImagesPullingTime="377.521801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:14.367975005 +0000 UTC m=+2034.219589171" watchObservedRunningTime="2026-07-07 16:52:14.369875685 +0000 UTC m=+2034.221489867"
Jul 07 16:52:20.328756 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.328730    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:20.810696 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.810663    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"]
Jul 07 16:52:20.814748 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.814726    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:20.818963 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.818924    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-d0ba35-serving-cert\""
Jul 07 16:52:20.826508 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.826427    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"]
Jul 07 16:52:20.917375 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.917348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28579acc-2d43-4798-80cf-b20456e72790-maas-api-tls\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:20.917532 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.917397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswtr\" (UniqueName: \"kubernetes.io/projected/28579acc-2d43-4798-80cf-b20456e72790-kube-api-access-xswtr\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:20.917532 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:20.917517    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28579acc-2d43-4798-80cf-b20456e72790-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.018418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.018382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswtr\" (UniqueName: \"kubernetes.io/projected/28579acc-2d43-4798-80cf-b20456e72790-kube-api-access-xswtr\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.018591 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.018469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28579acc-2d43-4798-80cf-b20456e72790-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.018591 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.018515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28579acc-2d43-4798-80cf-b20456e72790-maas-api-tls\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.019279 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.019249    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28579acc-2d43-4798-80cf-b20456e72790-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.020894 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.020872    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28579acc-2d43-4798-80cf-b20456e72790-maas-api-tls\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.029332 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.029306    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswtr\" (UniqueName: \"kubernetes.io/projected/28579acc-2d43-4798-80cf-b20456e72790-kube-api-access-xswtr\") pod \"maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") " pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.126632 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.126550    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:21.272823 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.272785    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"]
Jul 07 16:52:21.274589 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:52:21.274561    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28579acc_2d43_4798_80cf_b20456e72790.slice/crio-1a22392d587a4f071567f12d4c40eed02ba25a69f7f5f59b96ee1d6bd4cddded WatchSource:0}: Error finding container 1a22392d587a4f071567f12d4c40eed02ba25a69f7f5f59b96ee1d6bd4cddded: Status 404 returned error can't find the container with id 1a22392d587a4f071567f12d4c40eed02ba25a69f7f5f59b96ee1d6bd4cddded
Jul 07 16:52:21.353856 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:21.353824    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc" event={"ID":"28579acc-2d43-4798-80cf-b20456e72790","Type":"ContainerStarted","Data":"1a22392d587a4f071567f12d4c40eed02ba25a69f7f5f59b96ee1d6bd4cddded"}
Jul 07 16:52:22.360515 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:22.360478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc" event={"ID":"28579acc-2d43-4798-80cf-b20456e72790","Type":"ContainerStarted","Data":"e31e09c9c25c3a17fef568264e5fe21cfd91531886e32f1834169668cf67f08b"}
Jul 07 16:52:22.361024 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:22.360541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:22.381395 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:22.381348    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc" podStartSLOduration=2.032296252 podStartE2EDuration="2.381333255s" totalImagesPullingTime="349.037003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:22.379131235 +0000 UTC m=+2042.230745409" watchObservedRunningTime="2026-07-07 16:52:22.381333255 +0000 UTC m=+2042.232947427"
Jul 07 16:52:28.370916 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:28.370886    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:34.095046 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.095013    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"]
Jul 07 16:52:34.095622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.095224    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj" podUID="b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" containerName="maas-api" containerID="cri-o://ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700" gracePeriod=30
Jul 07 16:52:34.344649 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.344622    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:34.421701 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.421670    2573 generic.go:356] "Generic (PLEG): container finished" podID="b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" containerID="ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700" exitCode=0
Jul 07 16:52:34.421866 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.421722    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"
Jul 07 16:52:34.421866 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.421749    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj" event={"ID":"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac","Type":"ContainerDied","Data":"ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700"}
Jul 07 16:52:34.421866 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.421808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj" event={"ID":"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac","Type":"ContainerDied","Data":"a7061d035d697d164def35e39e7613d520616eec27b601e0f3b56fb2d5ec7b4d"}
Jul 07 16:52:34.421866 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.421839    2573 scope.go:117] "RemoveContainer" containerID="ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700"
Jul 07 16:52:34.430460 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.430442    2573 scope.go:117] "RemoveContainer" containerID="ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700"
Jul 07 16:52:34.430736 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:52:34.430720    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700\": container with ID starting with ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700 not found: ID does not exist" containerID="ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700"
Jul 07 16:52:34.430781 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.430744    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700"} err="failed to get container status \"ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700\": rpc error: code = NotFound desc = could not find container \"ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700\": container with ID starting with ea7f8d227936766728c47c664f9f1400fb0a73ef9c0cce8465c10a7bb3157700 not found: ID does not exist"
Jul 07 16:52:34.440149 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.440130    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-openshift-service-ca\") pod \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") "
Jul 07 16:52:34.440278 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.440198    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h44d9\" (UniqueName: \"kubernetes.io/projected/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-kube-api-access-h44d9\") pod \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") "
Jul 07 16:52:34.440278 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.440257    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-maas-api-tls\") pod \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\" (UID: \"b28d9e24-5e74-429a-9aa1-086cd6d5b0ac\") "
Jul 07 16:52:34.440471 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.440448    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" (UID: "b28d9e24-5e74-429a-9aa1-086cd6d5b0ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:34.440569 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.440553    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:34.442112 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.442090    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-kube-api-access-h44d9" (OuterVolumeSpecName: "kube-api-access-h44d9") pod "b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" (UID: "b28d9e24-5e74-429a-9aa1-086cd6d5b0ac"). InnerVolumeSpecName "kube-api-access-h44d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:34.442211 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.442193    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" (UID: "b28d9e24-5e74-429a-9aa1-086cd6d5b0ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:52:34.541787 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.541755    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:34.541787 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.541780    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h44d9\" (UniqueName: \"kubernetes.io/projected/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac-kube-api-access-h44d9\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:34.738384 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.738307    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"]
Jul 07 16:52:34.749009 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:34.748984    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-6a9526-684d54b957-7cclj"]
Jul 07 16:52:36.659095 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:36.659057    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" path="/var/lib/kubelet/pods/b28d9e24-5e74-429a-9aa1-086cd6d5b0ac/volumes"
Jul 07 16:52:41.337693 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.337656    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"]
Jul 07 16:52:41.338160 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.337973    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc" podUID="28579acc-2d43-4798-80cf-b20456e72790" containerName="maas-api" containerID="cri-o://e31e09c9c25c3a17fef568264e5fe21cfd91531886e32f1834169668cf67f08b" gracePeriod=30
Jul 07 16:52:41.457097 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.457066    2573 generic.go:356] "Generic (PLEG): container finished" podID="28579acc-2d43-4798-80cf-b20456e72790" containerID="e31e09c9c25c3a17fef568264e5fe21cfd91531886e32f1834169668cf67f08b" exitCode=0
Jul 07 16:52:41.457224 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.457155    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc" event={"ID":"28579acc-2d43-4798-80cf-b20456e72790","Type":"ContainerDied","Data":"e31e09c9c25c3a17fef568264e5fe21cfd91531886e32f1834169668cf67f08b"}
Jul 07 16:52:41.587281 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.587254    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:41.710233 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.710185    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28579acc-2d43-4798-80cf-b20456e72790-maas-api-tls\") pod \"28579acc-2d43-4798-80cf-b20456e72790\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") "
Jul 07 16:52:41.710409 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.710341    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xswtr\" (UniqueName: \"kubernetes.io/projected/28579acc-2d43-4798-80cf-b20456e72790-kube-api-access-xswtr\") pod \"28579acc-2d43-4798-80cf-b20456e72790\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") "
Jul 07 16:52:41.710409 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.710376    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28579acc-2d43-4798-80cf-b20456e72790-openshift-service-ca\") pod \"28579acc-2d43-4798-80cf-b20456e72790\" (UID: \"28579acc-2d43-4798-80cf-b20456e72790\") "
Jul 07 16:52:41.710763 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.710736    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28579acc-2d43-4798-80cf-b20456e72790-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28579acc-2d43-4798-80cf-b20456e72790" (UID: "28579acc-2d43-4798-80cf-b20456e72790"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:41.712204 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.712176    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28579acc-2d43-4798-80cf-b20456e72790-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28579acc-2d43-4798-80cf-b20456e72790" (UID: "28579acc-2d43-4798-80cf-b20456e72790"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:52:41.712337 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.712303    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28579acc-2d43-4798-80cf-b20456e72790-kube-api-access-xswtr" (OuterVolumeSpecName: "kube-api-access-xswtr") pod "28579acc-2d43-4798-80cf-b20456e72790" (UID: "28579acc-2d43-4798-80cf-b20456e72790"). InnerVolumeSpecName "kube-api-access-xswtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:41.811810 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.811774    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xswtr\" (UniqueName: \"kubernetes.io/projected/28579acc-2d43-4798-80cf-b20456e72790-kube-api-access-xswtr\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:41.811810 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.811803    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28579acc-2d43-4798-80cf-b20456e72790-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:41.811810 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:41.811815    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28579acc-2d43-4798-80cf-b20456e72790-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:52:42.464036 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:42.464003    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc" event={"ID":"28579acc-2d43-4798-80cf-b20456e72790","Type":"ContainerDied","Data":"1a22392d587a4f071567f12d4c40eed02ba25a69f7f5f59b96ee1d6bd4cddded"}
Jul 07 16:52:42.464467 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:42.464040    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"
Jul 07 16:52:42.464467 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:42.464060    2573 scope.go:117] "RemoveContainer" containerID="e31e09c9c25c3a17fef568264e5fe21cfd91531886e32f1834169668cf67f08b"
Jul 07 16:52:42.487141 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:42.487117    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"]
Jul 07 16:52:42.492403 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:42.492377    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0ba35-558d68d4b6-p4lhc"]
Jul 07 16:52:42.658617 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:42.658584    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28579acc-2d43-4798-80cf-b20456e72790" path="/var/lib/kubelet/pods/28579acc-2d43-4798-80cf-b20456e72790/volumes"
Jul 07 16:52:50.831808 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.831777    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"]
Jul 07 16:52:50.832191 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.832182    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28579acc-2d43-4798-80cf-b20456e72790" containerName="maas-api"
Jul 07 16:52:50.832238 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.832195    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="28579acc-2d43-4798-80cf-b20456e72790" containerName="maas-api"
Jul 07 16:52:50.832238 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.832215    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" containerName="maas-api"
Jul 07 16:52:50.832238 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.832220    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" containerName="maas-api"
Jul 07 16:52:50.832335 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.832290    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="28579acc-2d43-4798-80cf-b20456e72790" containerName="maas-api"
Jul 07 16:52:50.832335 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.832300    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28d9e24-5e74-429a-9aa1-086cd6d5b0ac" containerName="maas-api"
Jul 07 16:52:50.836323 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.836304    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:50.839266 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.839244    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-9926c0-serving-cert\""
Jul 07 16:52:50.851727 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.851705    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"]
Jul 07 16:52:50.899225 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.899189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:50.899225 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.899225    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:50.899442 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:50.899355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnflr\" (UniqueName: \"kubernetes.io/projected/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-kube-api-access-rnflr\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.000623 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.000584    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnflr\" (UniqueName: \"kubernetes.io/projected/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-kube-api-access-rnflr\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.000798 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.000662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.000798 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.000683    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.000867 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:52:51.000810    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-9926c0-serving-cert: secret "maas-api-e2e-shared-a-9926c0-serving-cert" not found
Jul 07 16:52:51.000903 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:52:51.000892    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls podName:915c7ef2-ee04-429d-9ae4-69fc12c1e1e8 nodeName:}" failed. No retries permitted until 2026-07-07 16:52:51.500871913 +0000 UTC m=+2071.352486072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls") pod "maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" (UID: "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8") : secret "maas-api-e2e-shared-a-9926c0-serving-cert" not found
Jul 07 16:52:51.001416 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.001398    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.013370 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.013345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnflr\" (UniqueName: \"kubernetes.io/projected/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-kube-api-access-rnflr\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.506750 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.506667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.509419 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.509395    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") " pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.746643 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.746612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:51.888647 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:51.888622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"]
Jul 07 16:52:51.890906 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:52:51.890881    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915c7ef2_ee04_429d_9ae4_69fc12c1e1e8.slice/crio-32cb0db3ed3a30a17a0e0563064b41e84ca0dec0075ed7016823f42ff3153f51 WatchSource:0}: Error finding container 32cb0db3ed3a30a17a0e0563064b41e84ca0dec0075ed7016823f42ff3153f51: Status 404 returned error can't find the container with id 32cb0db3ed3a30a17a0e0563064b41e84ca0dec0075ed7016823f42ff3153f51
Jul 07 16:52:52.518171 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:52.518143    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" event={"ID":"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8","Type":"ContainerStarted","Data":"f7585969a7c044f923d50fbc9ca067a02771fea0fba3e001d156508db57b991a"}
Jul 07 16:52:52.518307 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:52.518207    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:52.518307 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:52.518231    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" event={"ID":"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8","Type":"ContainerStarted","Data":"32cb0db3ed3a30a17a0e0563064b41e84ca0dec0075ed7016823f42ff3153f51"}
Jul 07 16:52:52.539202 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:52.539153    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" podStartSLOduration=1.99391197 podStartE2EDuration="2.539136228s" totalImagesPullingTime="545.224258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:52.53752583 +0000 UTC m=+2072.389140003" watchObservedRunningTime="2026-07-07 16:52:52.539136228 +0000 UTC m=+2072.390750402"
Jul 07 16:52:58.528882 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:58.528848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:52:59.007985 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.007939    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"]
Jul 07 16:52:59.011449 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.011433    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.014161 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.014137    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-3c33bd-serving-cert\""
Jul 07 16:52:59.026475 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.026409    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"]
Jul 07 16:52:59.074943 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.074913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.075165 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.074980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.075165 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.075046    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsp7d\" (UniqueName: \"kubernetes.io/projected/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-kube-api-access-dsp7d\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.175665 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.175630    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.175665 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.175668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.175923 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:52:59.175758    2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-3c33bd-serving-cert: secret "maas-api-e2e-shared-b-3c33bd-serving-cert" not found
Jul 07 16:52:59.175923 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:52:59.175806    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls podName:0fba42c0-c621-43d7-9ff0-cb36d5d5446f nodeName:}" failed. No retries permitted until 2026-07-07 16:52:59.675791073 +0000 UTC m=+2079.527405223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls") pod "maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" (UID: "0fba42c0-c621-43d7-9ff0-cb36d5d5446f") : secret "maas-api-e2e-shared-b-3c33bd-serving-cert" not found
Jul 07 16:52:59.175923 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.175804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsp7d\" (UniqueName: \"kubernetes.io/projected/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-kube-api-access-dsp7d\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.176350 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.176333    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.194822 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.194789    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsp7d\" (UniqueName: \"kubernetes.io/projected/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-kube-api-access-dsp7d\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.681677 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.681637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.684120 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.684094    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls\") pod \"maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") " pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:52:59.921241 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:52:59.921211    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:53:00.061897 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:00.061868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"]
Jul 07 16:53:00.064175 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:53:00.064150    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fba42c0_c621_43d7_9ff0_cb36d5d5446f.slice/crio-185ab8eb7203a11ddc5e5a19df06ca932d4fbaf765f70d5c0cf3b2836eadb7a3 WatchSource:0}: Error finding container 185ab8eb7203a11ddc5e5a19df06ca932d4fbaf765f70d5c0cf3b2836eadb7a3: Status 404 returned error can't find the container with id 185ab8eb7203a11ddc5e5a19df06ca932d4fbaf765f70d5c0cf3b2836eadb7a3
Jul 07 16:53:00.561267 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:00.561240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" event={"ID":"0fba42c0-c621-43d7-9ff0-cb36d5d5446f","Type":"ContainerStarted","Data":"185ab8eb7203a11ddc5e5a19df06ca932d4fbaf765f70d5c0cf3b2836eadb7a3"}
Jul 07 16:53:01.568027 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:01.567990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" event={"ID":"0fba42c0-c621-43d7-9ff0-cb36d5d5446f","Type":"ContainerStarted","Data":"e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618"}
Jul 07 16:53:01.568434 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:01.568132    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:53:01.588440 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:01.588389    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" podStartSLOduration=3.143209322 podStartE2EDuration="3.588373445s" totalImagesPullingTime="445.164123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:01.587153029 +0000 UTC m=+2081.438767201" watchObservedRunningTime="2026-07-07 16:53:01.588373445 +0000 UTC m=+2081.439987618"
Jul 07 16:53:07.578655 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:07.578624    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:53:20.778622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:20.778509    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:53:20.782828 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:20.782806    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:53:20.783110 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:20.783093    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:53:20.787819 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:20.787800    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:53:41.561673 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.561637    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"]
Jul 07 16:53:41.565259 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.565244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.570637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.570556    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"kube-root-ca.crt\""
Jul 07 16:53:41.570637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.570586    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"default-dockercfg-v8b56\""
Jul 07 16:53:41.570637 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.570625    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"openshift-service-ca.crt\""
Jul 07 16:53:41.570918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.570647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"auth-test-model-3c33bd-kserve-self-signed-certs\""
Jul 07 16:53:41.577921 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.577897    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"]
Jul 07 16:53:41.682588 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.682554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-dshm\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.682791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.682602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tls-certs\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.682791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.682636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-home\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.682791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.682650    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tmp-dir\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.682791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.682673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-model-cache\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.682791 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.682691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzfx\" (UniqueName: \"kubernetes.io/projected/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-kube-api-access-jwzfx\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.783986 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.783934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-home\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.783986 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.783987    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tmp-dir\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-model-cache\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzfx\" (UniqueName: \"kubernetes.io/projected/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-kube-api-access-jwzfx\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784250 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-dshm\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784444 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784410    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-home\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784506 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784422    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-model-cache\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784560 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784537    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tmp-dir\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.784618 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.784554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tls-certs\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.786395 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.786373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-dshm\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.786664 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.786645    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tls-certs\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.792757 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.792735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzfx\" (UniqueName: \"kubernetes.io/projected/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-kube-api-access-jwzfx\") pod \"auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") " pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:41.875731 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:41.875639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:42.016786 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:42.016749    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"]
Jul 07 16:53:42.020161 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:53:42.020137    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cc3b9d2_8a74_4c22_8c83_68b5b237bd4c.slice/crio-3804ad12669b9875b8c49457d9163ed3e84d8b6a04e83e92e7b07dbef4294fec WatchSource:0}: Error finding container 3804ad12669b9875b8c49457d9163ed3e84d8b6a04e83e92e7b07dbef4294fec: Status 404 returned error can't find the container with id 3804ad12669b9875b8c49457d9163ed3e84d8b6a04e83e92e7b07dbef4294fec
Jul 07 16:53:42.783580 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:42.783540    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9" event={"ID":"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c","Type":"ContainerStarted","Data":"43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b"}
Jul 07 16:53:42.784061 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:42.783588    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9" event={"ID":"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c","Type":"ContainerStarted","Data":"3804ad12669b9875b8c49457d9163ed3e84d8b6a04e83e92e7b07dbef4294fec"}
Jul 07 16:53:42.807260 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:42.807211    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9" podStartSLOduration=1.807191064 podStartE2EDuration="1.807191064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:42.804541949 +0000 UTC m=+2122.656156127" watchObservedRunningTime="2026-07-07 16:53:42.807191064 +0000 UTC m=+2122.658805236"
Jul 07 16:53:51.876530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:51.876498    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:51.876530 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:51.876537    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:51.889226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:51.889202    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:53:52.847103 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:53:52.847072    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:55:47.459165 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:47.459123    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"]
Jul 07 16:55:52.971054 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.971021    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"]
Jul 07 16:55:52.974338 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.974321    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:52.978069 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.978039    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"kube-root-ca.crt\""
Jul 07 16:55:52.978069 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.978052    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"default-dockercfg-w5pzn\""
Jul 07 16:55:52.978263 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.978060    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"sub-test-model-9926c0-kserve-self-signed-certs\""
Jul 07 16:55:52.978263 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.978103    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"openshift-service-ca.crt\""
Jul 07 16:55:52.986755 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:52.986732    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"]
Jul 07 16:55:53.134125 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.134096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-home\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.134297 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.134172    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27rwf\" (UniqueName: \"kubernetes.io/projected/27bef6ba-dffe-4092-8380-80fa9e91710c-kube-api-access-27rwf\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.134297 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.134227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-dshm\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.134378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.134293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27bef6ba-dffe-4092-8380-80fa9e91710c-tls-certs\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.134378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.134325    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-model-cache\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.134378 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.134358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-tmp-dir\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-dshm\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235364    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27bef6ba-dffe-4092-8380-80fa9e91710c-tls-certs\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235402 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235380    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-model-cache\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235646 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-tmp-dir\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235646 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-home\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235757 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27rwf\" (UniqueName: \"kubernetes.io/projected/27bef6ba-dffe-4092-8380-80fa9e91710c-kube-api-access-27rwf\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-model-cache\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.235996 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.235895    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-tmp-dir\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.236053 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.236018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-home\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.238202 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.238178    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-dshm\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.238406 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.238390    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27bef6ba-dffe-4092-8380-80fa9e91710c-tls-certs\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.246221 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.246189    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27rwf\" (UniqueName: \"kubernetes.io/projected/27bef6ba-dffe-4092-8380-80fa9e91710c-kube-api-access-27rwf\") pod \"sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") " pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.283295 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.283270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:55:53.418886 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.418861    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"]
Jul 07 16:55:53.420641 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:55:53.420609    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27bef6ba_dffe_4092_8380_80fa9e91710c.slice/crio-a2801d5b326333acd42cd2defcd41a71d669a3f87c2cde5f001010a1d20a57cc WatchSource:0}: Error finding container a2801d5b326333acd42cd2defcd41a71d669a3f87c2cde5f001010a1d20a57cc: Status 404 returned error can't find the container with id a2801d5b326333acd42cd2defcd41a71d669a3f87c2cde5f001010a1d20a57cc
Jul 07 16:55:53.433002 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:53.432981    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm" event={"ID":"27bef6ba-dffe-4092-8380-80fa9e91710c","Type":"ContainerStarted","Data":"a2801d5b326333acd42cd2defcd41a71d669a3f87c2cde5f001010a1d20a57cc"}
Jul 07 16:55:54.440294 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:54.440258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm" event={"ID":"27bef6ba-dffe-4092-8380-80fa9e91710c","Type":"ContainerStarted","Data":"8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f"}
Jul 07 16:55:54.459847 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:55:54.459793    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm" podStartSLOduration=2.459778324 podStartE2EDuration="2.459778324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:55:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:55:54.458173322 +0000 UTC m=+2254.309787498" watchObservedRunningTime="2026-07-07 16:55:54.459778324 +0000 UTC m=+2254.311392496"
Jul 07 16:56:02.482548 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.482476    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9" podUID="9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" containerName="main" containerID="cri-o://43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b" gracePeriod=45
Jul 07 16:56:02.733797 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.733730    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:56:02.826656 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.826615    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwzfx\" (UniqueName: \"kubernetes.io/projected/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-kube-api-access-jwzfx\") pod \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") "
Jul 07 16:56:02.826656 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.826667    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tls-certs\") pod \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") "
Jul 07 16:56:02.826918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.826701    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tmp-dir\") pod \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") "
Jul 07 16:56:02.826918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.826758    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-dshm\") pod \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") "
Jul 07 16:56:02.826918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.826779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-home\") pod \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") "
Jul 07 16:56:02.826918 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.826797    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-model-cache\") pod \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\" (UID: \"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c\") "
Jul 07 16:56:02.827163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.827096    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" (UID: "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:02.827163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.827085    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-home" (OuterVolumeSpecName: "home") pod "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" (UID: "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:02.827235 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.827154    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" (UID: "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:02.829006 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.828980    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-dshm" (OuterVolumeSpecName: "dshm") pod "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" (UID: "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:02.829084 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.829037    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" (UID: "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:56:02.829155 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.829130    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-kube-api-access-jwzfx" (OuterVolumeSpecName: "kube-api-access-jwzfx") pod "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" (UID: "9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c"). InnerVolumeSpecName "kube-api-access-jwzfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:56:02.928418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.928365    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwzfx\" (UniqueName: \"kubernetes.io/projected/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-kube-api-access-jwzfx\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:56:02.928418 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.928406    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tls-certs\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:56:02.928697 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.928444    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-tmp-dir\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:56:02.928697 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.928457    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-dshm\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:56:02.928697 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.928467    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-home\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:56:02.928697 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:02.928478    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c-model-cache\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:56:03.283385 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.283351    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:56:03.283576 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.283405    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:56:03.295964 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.295920    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:56:03.489714 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.489681    2573 generic.go:356] "Generic (PLEG): container finished" podID="9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" containerID="43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b" exitCode=0
Jul 07 16:56:03.490163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.489726    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"
Jul 07 16:56:03.490163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.489761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9" event={"ID":"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c","Type":"ContainerDied","Data":"43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b"}
Jul 07 16:56:03.490163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.489811    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9" event={"ID":"9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c","Type":"ContainerDied","Data":"3804ad12669b9875b8c49457d9163ed3e84d8b6a04e83e92e7b07dbef4294fec"}
Jul 07 16:56:03.490163 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.489835    2573 scope.go:117] "RemoveContainer" containerID="43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b"
Jul 07 16:56:03.499975 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.499943    2573 scope.go:117] "RemoveContainer" containerID="43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b"
Jul 07 16:56:03.500261 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:56:03.500243    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b\": container with ID starting with 43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b not found: ID does not exist" containerID="43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b"
Jul 07 16:56:03.500337 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.500270    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b"} err="failed to get container status \"43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b\": rpc error: code = NotFound desc = could not find container \"43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b\": container with ID starting with 43418fb0d7e4e68c870d0a8d53260e2e5600d8f21eaafb9f674cb9c7da5d509b not found: ID does not exist"
Jul 07 16:56:03.502362 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.502339    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:56:03.514932 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.514781    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"]
Jul 07 16:56:03.517107 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:03.517081    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/auth-test-model-3c33bd-kserve-d5c4d9b8c-l5vh9"]
Jul 07 16:56:04.659704 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:56:04.659669    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" path="/var/lib/kubelet/pods/9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c/volumes"
Jul 07 16:57:09.291206 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:09.291168    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"]
Jul 07 16:57:24.310930 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.310839    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm" podUID="27bef6ba-dffe-4092-8380-80fa9e91710c" containerName="main" containerID="cri-o://8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f" gracePeriod=45
Jul 07 16:57:24.557114 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.557089    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:57:24.622016 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.621922    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27bef6ba-dffe-4092-8380-80fa9e91710c-tls-certs\") pod \"27bef6ba-dffe-4092-8380-80fa9e91710c\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") "
Jul 07 16:57:24.622016 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622006    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-home\") pod \"27bef6ba-dffe-4092-8380-80fa9e91710c\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") "
Jul 07 16:57:24.622212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622041    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-tmp-dir\") pod \"27bef6ba-dffe-4092-8380-80fa9e91710c\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") "
Jul 07 16:57:24.622212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622136    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27rwf\" (UniqueName: \"kubernetes.io/projected/27bef6ba-dffe-4092-8380-80fa9e91710c-kube-api-access-27rwf\") pod \"27bef6ba-dffe-4092-8380-80fa9e91710c\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") "
Jul 07 16:57:24.622212 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622176    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-model-cache\") pod \"27bef6ba-dffe-4092-8380-80fa9e91710c\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") "
Jul 07 16:57:24.622352 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622231    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-dshm\") pod \"27bef6ba-dffe-4092-8380-80fa9e91710c\" (UID: \"27bef6ba-dffe-4092-8380-80fa9e91710c\") "
Jul 07 16:57:24.622352 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622251    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-home" (OuterVolumeSpecName: "home") pod "27bef6ba-dffe-4092-8380-80fa9e91710c" (UID: "27bef6ba-dffe-4092-8380-80fa9e91710c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:24.622352 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622270    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27bef6ba-dffe-4092-8380-80fa9e91710c" (UID: "27bef6ba-dffe-4092-8380-80fa9e91710c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:24.622517 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622494    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-model-cache" (OuterVolumeSpecName: "model-cache") pod "27bef6ba-dffe-4092-8380-80fa9e91710c" (UID: "27bef6ba-dffe-4092-8380-80fa9e91710c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:24.622607 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622590    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-model-cache\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:57:24.622654 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622610    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-home\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:57:24.622654 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.622625    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-tmp-dir\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:57:24.624259 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.624234    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27bef6ba-dffe-4092-8380-80fa9e91710c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27bef6ba-dffe-4092-8380-80fa9e91710c" (UID: "27bef6ba-dffe-4092-8380-80fa9e91710c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:57:24.624259 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.624240    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-dshm" (OuterVolumeSpecName: "dshm") pod "27bef6ba-dffe-4092-8380-80fa9e91710c" (UID: "27bef6ba-dffe-4092-8380-80fa9e91710c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:24.624407 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.624303    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27bef6ba-dffe-4092-8380-80fa9e91710c-kube-api-access-27rwf" (OuterVolumeSpecName: "kube-api-access-27rwf") pod "27bef6ba-dffe-4092-8380-80fa9e91710c" (UID: "27bef6ba-dffe-4092-8380-80fa9e91710c"). InnerVolumeSpecName "kube-api-access-27rwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:24.724150 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.724117    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27bef6ba-dffe-4092-8380-80fa9e91710c-tls-certs\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:57:24.724150 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.724143    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27rwf\" (UniqueName: \"kubernetes.io/projected/27bef6ba-dffe-4092-8380-80fa9e91710c-kube-api-access-27rwf\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:57:24.724150 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.724154    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27bef6ba-dffe-4092-8380-80fa9e91710c-dshm\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:57:24.902371 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.902338    2573 generic.go:356] "Generic (PLEG): container finished" podID="27bef6ba-dffe-4092-8380-80fa9e91710c" containerID="8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f" exitCode=0
Jul 07 16:57:24.902571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.902396    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"
Jul 07 16:57:24.902571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.902410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm" event={"ID":"27bef6ba-dffe-4092-8380-80fa9e91710c","Type":"ContainerDied","Data":"8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f"}
Jul 07 16:57:24.902571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.902454    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm" event={"ID":"27bef6ba-dffe-4092-8380-80fa9e91710c","Type":"ContainerDied","Data":"a2801d5b326333acd42cd2defcd41a71d669a3f87c2cde5f001010a1d20a57cc"}
Jul 07 16:57:24.902571 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.902475    2573 scope.go:117] "RemoveContainer" containerID="8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f"
Jul 07 16:57:24.911184 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.911168    2573 scope.go:117] "RemoveContainer" containerID="8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f"
Jul 07 16:57:24.911400 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:57:24.911384    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f\": container with ID starting with 8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f not found: ID does not exist" containerID="8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f"
Jul 07 16:57:24.911449 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.911408    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f"} err="failed to get container status \"8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f\": rpc error: code = NotFound desc = could not find container \"8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f\": container with ID starting with 8f8e48ebe8438a548b54647f0e0f07f12f77a55b7b017cadbe90c3f3bc6c0d7f not found: ID does not exist"
Jul 07 16:57:24.919722 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.919700    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"]
Jul 07 16:57:24.924138 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:24.924117    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/sub-test-model-9926c0-kserve-7c4df59dd5-b7jxm"]
Jul 07 16:57:26.658928 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:26.658896    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27bef6ba-dffe-4092-8380-80fa9e91710c" path="/var/lib/kubelet/pods/27bef6ba-dffe-4092-8380-80fa9e91710c/volumes"
Jul 07 16:57:49.523760 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.523725    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"]
Jul 07 16:57:49.524280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.524129    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27bef6ba-dffe-4092-8380-80fa9e91710c" containerName="main"
Jul 07 16:57:49.524280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.524140    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="27bef6ba-dffe-4092-8380-80fa9e91710c" containerName="main"
Jul 07 16:57:49.524280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.524172    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" containerName="main"
Jul 07 16:57:49.524280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.524177    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" containerName="main"
Jul 07 16:57:49.524280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.524235    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="27bef6ba-dffe-4092-8380-80fa9e91710c" containerName="main"
Jul 07 16:57:49.524280 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.524244    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc3b9d2-8a74-4c22-8c83-68b5b237bd4c" containerName="main"
Jul 07 16:57:49.527495 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.527478    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.534192 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.534118    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"default-dockercfg-v8b56\""
Jul 07 16:57:49.534192 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.534142    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"openshift-service-ca.crt\""
Jul 07 16:57:49.534346 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.534118    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"rate-test-model-3c33bd-kserve-self-signed-certs\""
Jul 07 16:57:49.534404 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.534381    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"kube-root-ca.crt\""
Jul 07 16:57:49.546632 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.546609    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"]
Jul 07 16:57:49.559557 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.559529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-model-cache\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.559665 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.559564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e076711-0aa1-4b8b-aacf-22e9b6321340-tls-certs\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.559665 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.559590    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-dshm\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.559749 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.559687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-home\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.559793 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.559743    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-tmp-dir\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.559793 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.559784    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj5cg\" (UniqueName: \"kubernetes.io/projected/1e076711-0aa1-4b8b-aacf-22e9b6321340-kube-api-access-rj5cg\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.660789 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.660756    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-tmp-dir\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661018 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.660815    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj5cg\" (UniqueName: \"kubernetes.io/projected/1e076711-0aa1-4b8b-aacf-22e9b6321340-kube-api-access-rj5cg\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661091 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661066    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-model-cache\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661134 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e076711-0aa1-4b8b-aacf-22e9b6321340-tls-certs\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661206 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661193    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-dshm\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661248 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661221    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-tmp-dir\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661360 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-home\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.661398 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661355    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-model-cache\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.662023 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.661994    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-home\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.663551 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.663530    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-dshm\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.664104 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.664084    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e076711-0aa1-4b8b-aacf-22e9b6321340-tls-certs\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.670873 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.670848    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj5cg\" (UniqueName: \"kubernetes.io/projected/1e076711-0aa1-4b8b-aacf-22e9b6321340-kube-api-access-rj5cg\") pod \"rate-test-model-3c33bd-kserve-7986876cf-xjtzw\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") " pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.837045 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.836966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:49.974922 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:49.974890    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"]
Jul 07 16:57:49.978080 ip-10-0-135-243 kubenswrapper[2573]: W0707 16:57:49.978044    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e076711_0aa1_4b8b_aacf_22e9b6321340.slice/crio-2c81610ca25519145631772249dac64913ee88700846b4f08e6719030bc2c8e0 WatchSource:0}: Error finding container 2c81610ca25519145631772249dac64913ee88700846b4f08e6719030bc2c8e0: Status 404 returned error can't find the container with id 2c81610ca25519145631772249dac64913ee88700846b4f08e6719030bc2c8e0
Jul 07 16:57:50.032604 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:50.032578    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw" event={"ID":"1e076711-0aa1-4b8b-aacf-22e9b6321340","Type":"ContainerStarted","Data":"2c81610ca25519145631772249dac64913ee88700846b4f08e6719030bc2c8e0"}
Jul 07 16:57:51.039503 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:51.039462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw" event={"ID":"1e076711-0aa1-4b8b-aacf-22e9b6321340","Type":"ContainerStarted","Data":"a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4"}
Jul 07 16:57:51.061194 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:51.061145    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw" podStartSLOduration=2.061128084 podStartE2EDuration="2.061128084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:57:51.059822863 +0000 UTC m=+2370.911437051" watchObservedRunningTime="2026-07-07 16:57:51.061128084 +0000 UTC m=+2370.912742258"
Jul 07 16:57:59.838046 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:59.838013    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:59.838484 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:59.838063    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:57:59.850697 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:57:59.850674    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:58:00.096800 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:00.096710    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:58:20.811652 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:20.811537    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:58:20.816021 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:20.816000    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:58:20.820226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:20.820205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 16:58:20.823691 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:20.823675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm8f_c50a5804-912f-431f-87e2-8b1f5fddafa8/ovn-acl-logging/0.log"
Jul 07 16:58:51.131319 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:51.131281    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"]
Jul 07 16:58:53.140092 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.140059    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"]
Jul 07 16:58:53.140593 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.140256    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" podUID="915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" containerName="maas-api" containerID="cri-o://f7585969a7c044f923d50fbc9ca067a02771fea0fba3e001d156508db57b991a" gracePeriod=30
Jul 07 16:58:53.366574 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.366544    2573 generic.go:356] "Generic (PLEG): container finished" podID="915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" containerID="f7585969a7c044f923d50fbc9ca067a02771fea0fba3e001d156508db57b991a" exitCode=0
Jul 07 16:58:53.366720 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.366619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" event={"ID":"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8","Type":"ContainerDied","Data":"f7585969a7c044f923d50fbc9ca067a02771fea0fba3e001d156508db57b991a"}
Jul 07 16:58:53.393869 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.393812    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:58:53.481206 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.481178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-openshift-service-ca\") pod \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") "
Jul 07 16:58:53.481382 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.481233    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls\") pod \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") "
Jul 07 16:58:53.481382 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.481327    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnflr\" (UniqueName: \"kubernetes.io/projected/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-kube-api-access-rnflr\") pod \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\" (UID: \"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8\") "
Jul 07 16:58:53.481622 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.481594    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" (UID: "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:58:53.483315 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.483285    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" (UID: "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:58:53.483411 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.483314    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-kube-api-access-rnflr" (OuterVolumeSpecName: "kube-api-access-rnflr") pod "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" (UID: "915c7ef2-ee04-429d-9ae4-69fc12c1e1e8"). InnerVolumeSpecName "kube-api-access-rnflr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:58:53.582606 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.582579    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:58:53.582606 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.582602    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:58:53.582606 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:53.582611    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnflr\" (UniqueName: \"kubernetes.io/projected/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8-kube-api-access-rnflr\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:58:54.373093 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:54.373060    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"
Jul 07 16:58:54.373485 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:54.373103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc" event={"ID":"915c7ef2-ee04-429d-9ae4-69fc12c1e1e8","Type":"ContainerDied","Data":"32cb0db3ed3a30a17a0e0563064b41e84ca0dec0075ed7016823f42ff3153f51"}
Jul 07 16:58:54.373485 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:54.373169    2573 scope.go:117] "RemoveContainer" containerID="f7585969a7c044f923d50fbc9ca067a02771fea0fba3e001d156508db57b991a"
Jul 07 16:58:54.398075 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:54.398043    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"]
Jul 07 16:58:54.403608 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:54.403586    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9926c0-cd8dbfbb8-fv2gc"]
Jul 07 16:58:54.659725 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:58:54.659696    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" path="/var/lib/kubelet/pods/915c7ef2-ee04-429d-9ae4-69fc12c1e1e8/volumes"
Jul 07 16:59:06.152208 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.152143    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw" podUID="1e076711-0aa1-4b8b-aacf-22e9b6321340" containerName="main" containerID="cri-o://a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4" gracePeriod=45
Jul 07 16:59:06.417683 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.417657    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:59:06.440668 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.440638    2573 generic.go:356] "Generic (PLEG): container finished" podID="1e076711-0aa1-4b8b-aacf-22e9b6321340" containerID="a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4" exitCode=0
Jul 07 16:59:06.440813 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.440678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"
Jul 07 16:59:06.440813 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.440721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw" event={"ID":"1e076711-0aa1-4b8b-aacf-22e9b6321340","Type":"ContainerDied","Data":"a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4"}
Jul 07 16:59:06.440813 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.440768    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw" event={"ID":"1e076711-0aa1-4b8b-aacf-22e9b6321340","Type":"ContainerDied","Data":"2c81610ca25519145631772249dac64913ee88700846b4f08e6719030bc2c8e0"}
Jul 07 16:59:06.440813 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.440790    2573 scope.go:117] "RemoveContainer" containerID="a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4"
Jul 07 16:59:06.450908 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.450885    2573 scope.go:117] "RemoveContainer" containerID="a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4"
Jul 07 16:59:06.451182 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:59:06.451161    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4\": container with ID starting with a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4 not found: ID does not exist" containerID="a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4"
Jul 07 16:59:06.451258 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.451196    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4"} err="failed to get container status \"a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4\": rpc error: code = NotFound desc = could not find container \"a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4\": container with ID starting with a6c47a159264b68ba42f3ba595674b36b2128218e02e66049300283565d0a5a4 not found: ID does not exist"
Jul 07 16:59:06.504863 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.504835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e076711-0aa1-4b8b-aacf-22e9b6321340-tls-certs\") pod \"1e076711-0aa1-4b8b-aacf-22e9b6321340\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") "
Jul 07 16:59:06.505026 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.504907    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-model-cache\") pod \"1e076711-0aa1-4b8b-aacf-22e9b6321340\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") "
Jul 07 16:59:06.505026 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.504931    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-home\") pod \"1e076711-0aa1-4b8b-aacf-22e9b6321340\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") "
Jul 07 16:59:06.505026 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.504984    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-tmp-dir\") pod \"1e076711-0aa1-4b8b-aacf-22e9b6321340\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") "
Jul 07 16:59:06.505207 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505052    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj5cg\" (UniqueName: \"kubernetes.io/projected/1e076711-0aa1-4b8b-aacf-22e9b6321340-kube-api-access-rj5cg\") pod \"1e076711-0aa1-4b8b-aacf-22e9b6321340\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") "
Jul 07 16:59:06.505207 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505089    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-dshm\") pod \"1e076711-0aa1-4b8b-aacf-22e9b6321340\" (UID: \"1e076711-0aa1-4b8b-aacf-22e9b6321340\") "
Jul 07 16:59:06.505207 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505121    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e076711-0aa1-4b8b-aacf-22e9b6321340" (UID: "1e076711-0aa1-4b8b-aacf-22e9b6321340"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:06.505207 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505181    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-home" (OuterVolumeSpecName: "home") pod "1e076711-0aa1-4b8b-aacf-22e9b6321340" (UID: "1e076711-0aa1-4b8b-aacf-22e9b6321340"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:06.505379 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505279    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e076711-0aa1-4b8b-aacf-22e9b6321340" (UID: "1e076711-0aa1-4b8b-aacf-22e9b6321340"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:06.505444 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505426    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-model-cache\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.505444 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505444    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-home\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.505546 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.505453    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-tmp-dir\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.506939 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.506920    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e076711-0aa1-4b8b-aacf-22e9b6321340-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e076711-0aa1-4b8b-aacf-22e9b6321340" (UID: "1e076711-0aa1-4b8b-aacf-22e9b6321340"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:59:06.507029 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.506982    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e076711-0aa1-4b8b-aacf-22e9b6321340-kube-api-access-rj5cg" (OuterVolumeSpecName: "kube-api-access-rj5cg") pod "1e076711-0aa1-4b8b-aacf-22e9b6321340" (UID: "1e076711-0aa1-4b8b-aacf-22e9b6321340"). InnerVolumeSpecName "kube-api-access-rj5cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:06.507105 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.507080    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-dshm" (OuterVolumeSpecName: "dshm") pod "1e076711-0aa1-4b8b-aacf-22e9b6321340" (UID: "1e076711-0aa1-4b8b-aacf-22e9b6321340"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:06.606294 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.606260    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj5cg\" (UniqueName: \"kubernetes.io/projected/1e076711-0aa1-4b8b-aacf-22e9b6321340-kube-api-access-rj5cg\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.606294 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.606286    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e076711-0aa1-4b8b-aacf-22e9b6321340-dshm\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.606294 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.606297    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e076711-0aa1-4b8b-aacf-22e9b6321340-tls-certs\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.763539 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.763504    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"]
Jul 07 16:59:06.769108 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:06.769087    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/rate-test-model-3c33bd-kserve-7986876cf-xjtzw"]
Jul 07 16:59:08.659743 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:08.659709    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e076711-0aa1-4b8b-aacf-22e9b6321340" path="/var/lib/kubelet/pods/1e076711-0aa1-4b8b-aacf-22e9b6321340/volumes"
Jul 07 16:59:36.747736 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:36.747702    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"]
Jul 07 16:59:36.748299 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:36.747934    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" podUID="0fba42c0-c621-43d7-9ff0-cb36d5d5446f" containerName="maas-api" containerID="cri-o://e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618" gracePeriod=30
Jul 07 16:59:37.001776 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.001724    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:59:37.187694 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.187666    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls\") pod \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") "
Jul 07 16:59:37.187874 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.187706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-openshift-service-ca\") pod \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") "
Jul 07 16:59:37.187874 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.187812    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsp7d\" (UniqueName: \"kubernetes.io/projected/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-kube-api-access-dsp7d\") pod \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\" (UID: \"0fba42c0-c621-43d7-9ff0-cb36d5d5446f\") "
Jul 07 16:59:37.188155 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.188132    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0fba42c0-c621-43d7-9ff0-cb36d5d5446f" (UID: "0fba42c0-c621-43d7-9ff0-cb36d5d5446f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:59:37.189819 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.189800    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0fba42c0-c621-43d7-9ff0-cb36d5d5446f" (UID: "0fba42c0-c621-43d7-9ff0-cb36d5d5446f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:59:37.189891 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.189844    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-kube-api-access-dsp7d" (OuterVolumeSpecName: "kube-api-access-dsp7d") pod "0fba42c0-c621-43d7-9ff0-cb36d5d5446f" (UID: "0fba42c0-c621-43d7-9ff0-cb36d5d5446f"). InnerVolumeSpecName "kube-api-access-dsp7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:37.289287 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.289215    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsp7d\" (UniqueName: \"kubernetes.io/projected/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-kube-api-access-dsp7d\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:37.289287 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.289239    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-maas-api-tls\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:37.289287 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.289249    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fba42c0-c621-43d7-9ff0-cb36d5d5446f-openshift-service-ca\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 16:59:37.595619 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.595538    2573 generic.go:356] "Generic (PLEG): container finished" podID="0fba42c0-c621-43d7-9ff0-cb36d5d5446f" containerID="e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618" exitCode=0
Jul 07 16:59:37.595619 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.595577    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"
Jul 07 16:59:37.595619 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.595596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" event={"ID":"0fba42c0-c621-43d7-9ff0-cb36d5d5446f","Type":"ContainerDied","Data":"e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618"}
Jul 07 16:59:37.595821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.595644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62" event={"ID":"0fba42c0-c621-43d7-9ff0-cb36d5d5446f","Type":"ContainerDied","Data":"185ab8eb7203a11ddc5e5a19df06ca932d4fbaf765f70d5c0cf3b2836eadb7a3"}
Jul 07 16:59:37.595821 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.595668    2573 scope.go:117] "RemoveContainer" containerID="e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618"
Jul 07 16:59:37.605166 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.605147    2573 scope.go:117] "RemoveContainer" containerID="e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618"
Jul 07 16:59:37.605412 ip-10-0-135-243 kubenswrapper[2573]: E0707 16:59:37.605392    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618\": container with ID starting with e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618 not found: ID does not exist" containerID="e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618"
Jul 07 16:59:37.605514 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.605424    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618"} err="failed to get container status \"e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618\": rpc error: code = NotFound desc = could not find container \"e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618\": container with ID starting with e2865eb8708a703a4c2dbb21fba08b707e50b6c99b7081b90d64ce9cc74a0618 not found: ID does not exist"
Jul 07 16:59:37.617833 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.617806    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"]
Jul 07 16:59:37.622093 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:37.622071    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-3c33bd-5f6b968c44-tkx62"]
Jul 07 16:59:38.659039 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:38.659007    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fba42c0-c621-43d7-9ff0-cb36d5d5446f" path="/var/lib/kubelet/pods/0fba42c0-c621-43d7-9ff0-cb36d5d5446f/volumes"
Jul 07 16:59:48.076660 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:48.076633    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cdfbbc57c-t7hm7_c2f23e7d-7c02-4765-b010-7f6ab220dd6d/maas-api/0.log"
Jul 07 16:59:48.195448 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:48.195428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724030-vgxlq_2e365a39-505a-4dce-98b1-c2e9e5f32d4e/cleanup/0.log"
Jul 07 16:59:48.298216 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:48.298190    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724045-dzmzv_6d10cdcc-790d-4627-bfee-3629948ea07c/cleanup/0.log"
Jul 07 16:59:48.419058 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:48.419034    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d97f49c6-srzwm_d5d32387-f9b2-40ce-a3c8-2190a9c34242/manager/0.log"
Jul 07 16:59:49.031841 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:49.031816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-vgt4j_ed8a6902-f025-40ea-94b7-ab141dad306a/copy-manifests/0.log"
Jul 07 16:59:49.039322 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:49.039299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-vgt4j_ed8a6902-f025-40ea-94b7-ab141dad306a/manager/0.log"
Jul 07 16:59:49.154110 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:49.154088    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hsppn_3b7cb6cd-f7d6-4060-a0d4-83ed78d688af/postgres/0.log"
Jul 07 16:59:50.571362 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:50.571332    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ztvd7_e8bb7fff-a94a-475e-a34d-3b2370d474d9/manager/0.log"
Jul 07 16:59:50.798170 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:50.798144    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kjzbs_54c44be9-3996-4497-ae20-5d07b855fe71/kuadrant-console-plugin/0.log"
Jul 07 16:59:50.914623 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:50.914590    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4j4f8_4051db86-0cc7-40f2-95d8-80e84037dada/registry-server/0.log"
Jul 07 16:59:51.271633 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:51.271554    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mdl5x_a86e33a2-17c4-4a23-bab1-1fff6718c829/manager/0.log"
Jul 07 16:59:52.222302 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:52.222273    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cg6b4_f4a3b7d0-4d2f-4c49-8687-e1d474a09362/payload-pre-processing/0.log"
Jul 07 16:59:52.340226 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:52.340196    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9s4tz_cd29c741-6eed-4d29-9c79-9317747a527f/payload-processing/0.log"
Jul 07 16:59:52.455445 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:52.455422    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc9946d6c-2zf4h_3fbe5de2-adb7-4c64-917e-224067117816/router/0.log"
Jul 07 16:59:52.789093 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:52.789065    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mvv6f_af90d33d-c9e9-4e4b-ae9b-233cbc83ec34/main/0.log"
Jul 07 16:59:52.900354 ip-10-0-135-243 kubenswrapper[2573]: I0707 16:59:52.900328    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6hgxz_13b08560-db53-400b-915a-37003197f3d2/main/0.log"
Jul 07 17:00:00.139425 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139391    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724060-g2vcr"]
Jul 07 17:00:00.139804 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139791    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" containerName="maas-api"
Jul 07 17:00:00.139853 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139805    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" containerName="maas-api"
Jul 07 17:00:00.139853 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139817    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fba42c0-c621-43d7-9ff0-cb36d5d5446f" containerName="maas-api"
Jul 07 17:00:00.139853 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139822    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fba42c0-c621-43d7-9ff0-cb36d5d5446f" containerName="maas-api"
Jul 07 17:00:00.139853 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139829    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e076711-0aa1-4b8b-aacf-22e9b6321340" containerName="main"
Jul 07 17:00:00.139853 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139834    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e076711-0aa1-4b8b-aacf-22e9b6321340" containerName="main"
Jul 07 17:00:00.140052 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139890    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fba42c0-c621-43d7-9ff0-cb36d5d5446f" containerName="maas-api"
Jul 07 17:00:00.140052 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139899    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="915c7ef2-ee04-429d-9ae4-69fc12c1e1e8" containerName="maas-api"
Jul 07 17:00:00.140052 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.139906    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e076711-0aa1-4b8b-aacf-22e9b6321340" containerName="main"
Jul 07 17:00:00.142987 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.142966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:00.151057 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.151035    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724060-g2vcr"]
Jul 07 17:00:00.187121 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.187088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9dsk\" (UniqueName: \"kubernetes.io/projected/dc764d1f-6e92-41e4-bab0-a17e2d0d8820-kube-api-access-w9dsk\") pod \"maas-api-key-cleanup-29724060-g2vcr\" (UID: \"dc764d1f-6e92-41e4-bab0-a17e2d0d8820\") " pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:00.287802 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.287769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9dsk\" (UniqueName: \"kubernetes.io/projected/dc764d1f-6e92-41e4-bab0-a17e2d0d8820-kube-api-access-w9dsk\") pod \"maas-api-key-cleanup-29724060-g2vcr\" (UID: \"dc764d1f-6e92-41e4-bab0-a17e2d0d8820\") " pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:00.296974 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.296934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9dsk\" (UniqueName: \"kubernetes.io/projected/dc764d1f-6e92-41e4-bab0-a17e2d0d8820-kube-api-access-w9dsk\") pod \"maas-api-key-cleanup-29724060-g2vcr\" (UID: \"dc764d1f-6e92-41e4-bab0-a17e2d0d8820\") " pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:00.453910 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.453825    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:00.546509 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.546442    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xkn26_623fc414-12dd-4832-aa99-074449419721/global-pull-secret-syncer/0.log"
Jul 07 17:00:00.592866 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.592842    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724060-g2vcr"]
Jul 07 17:00:00.594464 ip-10-0-135-243 kubenswrapper[2573]: W0707 17:00:00.594437    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc764d1f_6e92_41e4_bab0_a17e2d0d8820.slice/crio-5a7e541e31ca2a20e4c82808b70bc24a6130615fba9adab92540be18cafa0d3c WatchSource:0}: Error finding container 5a7e541e31ca2a20e4c82808b70bc24a6130615fba9adab92540be18cafa0d3c: Status 404 returned error can't find the container with id 5a7e541e31ca2a20e4c82808b70bc24a6130615fba9adab92540be18cafa0d3c
Jul 07 17:00:00.693988 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.693944    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zxdfg_3ebb3925-f327-4dfd-ae03-b977412f6bdb/konnectivity-agent/0.log"
Jul 07 17:00:00.705783 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.705700    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr" event={"ID":"dc764d1f-6e92-41e4-bab0-a17e2d0d8820","Type":"ContainerStarted","Data":"5a7e541e31ca2a20e4c82808b70bc24a6130615fba9adab92540be18cafa0d3c"}
Jul 07 17:00:00.748980 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:00.748945    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-243.ec2.internal_dde6cf80b51827f1dbc1de58a509a849/haproxy/0.log"
Jul 07 17:00:01.711757 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:01.711712    2573 generic.go:356] "Generic (PLEG): container finished" podID="dc764d1f-6e92-41e4-bab0-a17e2d0d8820" containerID="a133f70353430f879b6c5a0a0a3c101cce7f587161be5075989aba47b26790d7" exitCode=0
Jul 07 17:00:01.712116 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:01.711772    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr" event={"ID":"dc764d1f-6e92-41e4-bab0-a17e2d0d8820","Type":"ContainerDied","Data":"a133f70353430f879b6c5a0a0a3c101cce7f587161be5075989aba47b26790d7"}
Jul 07 17:00:02.847558 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:02.847534    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:02.913658 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:02.913631    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9dsk\" (UniqueName: \"kubernetes.io/projected/dc764d1f-6e92-41e4-bab0-a17e2d0d8820-kube-api-access-w9dsk\") pod \"dc764d1f-6e92-41e4-bab0-a17e2d0d8820\" (UID: \"dc764d1f-6e92-41e4-bab0-a17e2d0d8820\") "
Jul 07 17:00:02.915631 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:02.915607    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc764d1f-6e92-41e4-bab0-a17e2d0d8820-kube-api-access-w9dsk" (OuterVolumeSpecName: "kube-api-access-w9dsk") pod "dc764d1f-6e92-41e4-bab0-a17e2d0d8820" (UID: "dc764d1f-6e92-41e4-bab0-a17e2d0d8820"). InnerVolumeSpecName "kube-api-access-w9dsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:00:03.014974 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:03.014872    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9dsk\" (UniqueName: \"kubernetes.io/projected/dc764d1f-6e92-41e4-bab0-a17e2d0d8820-kube-api-access-w9dsk\") on node \"ip-10-0-135-243.ec2.internal\" DevicePath \"\""
Jul 07 17:00:03.722691 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:03.722665    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr"
Jul 07 17:00:03.722866 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:03.722694    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724060-g2vcr" event={"ID":"dc764d1f-6e92-41e4-bab0-a17e2d0d8820","Type":"ContainerDied","Data":"5a7e541e31ca2a20e4c82808b70bc24a6130615fba9adab92540be18cafa0d3c"}
Jul 07 17:00:03.722866 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:03.722789    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a7e541e31ca2a20e4c82808b70bc24a6130615fba9adab92540be18cafa0d3c"
Jul 07 17:00:05.753956 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:05.753918    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ztvd7_e8bb7fff-a94a-475e-a34d-3b2370d474d9/manager/0.log"
Jul 07 17:00:05.834894 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:05.834868    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kjzbs_54c44be9-3996-4497-ae20-5d07b855fe71/kuadrant-console-plugin/0.log"
Jul 07 17:00:05.876038 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:05.876004    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4j4f8_4051db86-0cc7-40f2-95d8-80e84037dada/registry-server/0.log"
Jul 07 17:00:06.084265 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:06.084181    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mdl5x_a86e33a2-17c4-4a23-bab1-1fff6718c829/manager/0.log"
Jul 07 17:00:07.846581 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:07.846554    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/alertmanager/0.log"
Jul 07 17:00:07.893630 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:07.893603    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/config-reloader/0.log"
Jul 07 17:00:07.928353 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:07.928276    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/kube-rbac-proxy-web/0.log"
Jul 07 17:00:07.953769 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:07.953738    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/kube-rbac-proxy/0.log"
Jul 07 17:00:07.992961 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:07.992919    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/kube-rbac-proxy-metric/0.log"
Jul 07 17:00:08.019812 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.019789    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/prom-label-proxy/0.log"
Jul 07 17:00:08.074149 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.074121    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2829e0c6-962b-43e8-9032-6d739040469d/init-config-reloader/0.log"
Jul 07 17:00:08.156339 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.156312    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rrdjj_1b9711d8-5cd1-44db-9168-0fd7370228a3/kube-state-metrics/0.log"
Jul 07 17:00:08.186880 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.186816    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rrdjj_1b9711d8-5cd1-44db-9168-0fd7370228a3/kube-rbac-proxy-main/0.log"
Jul 07 17:00:08.215372 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.215350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-rrdjj_1b9711d8-5cd1-44db-9168-0fd7370228a3/kube-rbac-proxy-self/0.log"
Jul 07 17:00:08.270937 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.270911    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-668bb7d545-74rcs_8cde5855-ea82-4039-8c8d-773b11450e17/metrics-server/0.log"
Jul 07 17:00:08.343583 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.343560    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49t2d_ffd6e1af-b723-4fc4-a127-8fef95bff8f6/node-exporter/0.log"
Jul 07 17:00:08.373451 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.373424    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49t2d_ffd6e1af-b723-4fc4-a127-8fef95bff8f6/kube-rbac-proxy/0.log"
Jul 07 17:00:08.405869 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.405848    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49t2d_ffd6e1af-b723-4fc4-a127-8fef95bff8f6/init-textfile/0.log"
Jul 07 17:00:08.966385 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:08.966330    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/prometheus/0.log"
Jul 07 17:00:09.013815 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.013790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/config-reloader/0.log"
Jul 07 17:00:09.062822 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.062796    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/thanos-sidecar/0.log"
Jul 07 17:00:09.110186 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.110124    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/kube-rbac-proxy-web/0.log"
Jul 07 17:00:09.173892 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.173867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/kube-rbac-proxy/0.log"
Jul 07 17:00:09.221755 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.221710    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/kube-rbac-proxy-thanos/0.log"
Jul 07 17:00:09.264759 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.264740    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e41fc638-a991-4623-b48a-aadb42af27e1/init-config-reloader/0.log"
Jul 07 17:00:09.311726 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.311705    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tzhjp_d4f8f2a1-5c97-4203-ad25-e9bd27728a07/prometheus-operator/0.log"
Jul 07 17:00:09.348580 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.348559    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tzhjp_d4f8f2a1-5c97-4203-ad25-e9bd27728a07/kube-rbac-proxy/0.log"
Jul 07 17:00:09.393527 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:09.393504    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-xt2jb_50954389-061b-4107-a802-9109922377e9/prometheus-operator-admission-webhook/0.log"
Jul 07 17:00:10.376279 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.376244    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"]
Jul 07 17:00:10.376658 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.376644    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc764d1f-6e92-41e4-bab0-a17e2d0d8820" containerName="cleanup"
Jul 07 17:00:10.376703 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.376660    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc764d1f-6e92-41e4-bab0-a17e2d0d8820" containerName="cleanup"
Jul 07 17:00:10.376751 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.376741    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc764d1f-6e92-41e4-bab0-a17e2d0d8820" containerName="cleanup"
Jul 07 17:00:10.380101 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.380077    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.383506 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.383483    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-948xd\"/\"kube-root-ca.crt\""
Jul 07 17:00:10.384232 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.384216    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-948xd\"/\"default-dockercfg-6wmwk\""
Jul 07 17:00:10.384340 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.384237    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-948xd\"/\"openshift-service-ca.crt\""
Jul 07 17:00:10.395410 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.395382    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"]
Jul 07 17:00:10.487488 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.487449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-proc\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.487671 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.487502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwwnz\" (UniqueName: \"kubernetes.io/projected/6072e939-c33f-4071-a61d-f368e7143600-kube-api-access-dwwnz\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.487671 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.487602    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-lib-modules\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.487671 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.487631    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-podres\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.487671 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.487665    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-sys\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588312 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-proc\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588459 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwwnz\" (UniqueName: \"kubernetes.io/projected/6072e939-c33f-4071-a61d-f368e7143600-kube-api-access-dwwnz\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588459 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-lib-modules\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588459 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588389    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-proc\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588459 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-podres\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588459 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588449    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-sys\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588710 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-podres\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588710 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588514    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-sys\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.588710 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.588516    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6072e939-c33f-4071-a61d-f368e7143600-lib-modules\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.600687 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.600670    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwwnz\" (UniqueName: \"kubernetes.io/projected/6072e939-c33f-4071-a61d-f368e7143600-kube-api-access-dwwnz\") pod \"perf-node-gather-daemonset-mzzlb\" (UID: \"6072e939-c33f-4071-a61d-f368e7143600\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.689560 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.689536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:10.832546 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:10.832512    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"]
Jul 07 17:00:10.837278 ip-10-0-135-243 kubenswrapper[2573]: W0707 17:00:10.837243    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6072e939_c33f_4071_a61d_f368e7143600.slice/crio-a67380d5d0742be352c34c992c6a128f1a4ae13d4ebb66c1bfc17a52dc9753c0 WatchSource:0}: Error finding container a67380d5d0742be352c34c992c6a128f1a4ae13d4ebb66c1bfc17a52dc9753c0: Status 404 returned error can't find the container with id a67380d5d0742be352c34c992c6a128f1a4ae13d4ebb66c1bfc17a52dc9753c0
Jul 07 17:00:11.544905 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:11.544879    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/2.log"
Jul 07 17:00:11.548987 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:11.548962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-fwtrz_2b0e5183-067f-46dc-8ab4-5fea78445317/console-operator/3.log"
Jul 07 17:00:11.766117 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:11.766084    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb" event={"ID":"6072e939-c33f-4071-a61d-f368e7143600","Type":"ContainerStarted","Data":"0ce53a31088e5569bc60d25df04b02a005d4db51498fa32c0813e675c89ba4bf"}
Jul 07 17:00:11.766277 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:11.766176    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb" event={"ID":"6072e939-c33f-4071-a61d-f368e7143600","Type":"ContainerStarted","Data":"a67380d5d0742be352c34c992c6a128f1a4ae13d4ebb66c1bfc17a52dc9753c0"}
Jul 07 17:00:11.766277 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:11.766202    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:11.783543 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:11.783493    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb" podStartSLOduration=1.783478197 podStartE2EDuration="1.783478197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:00:11.782897254 +0000 UTC m=+2511.634511419" watchObservedRunningTime="2026-07-07 17:00:11.783478197 +0000 UTC m=+2511.635092379"
Jul 07 17:00:13.694651 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:13.694579    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rmd6_3bfec422-23c8-4bc5-831d-4f8262019c27/dns/0.log"
Jul 07 17:00:13.718010 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:13.717974    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rmd6_3bfec422-23c8-4bc5-831d-4f8262019c27/kube-rbac-proxy/0.log"
Jul 07 17:00:13.851656 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:13.851631    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cbw7m_ed0eb0c0-a23a-4d82-b558-8efa1860ff9a/dns-node-resolver/0.log"
Jul 07 17:00:14.475212 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:14.475181    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54fc4d477b-4cbzr_04765054-f322-49a3-b1a4-ecbe47af0901/registry/0.log"
Jul 07 17:00:14.503418 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:14.503391    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-khnvq_d41daa32-170a-4b6b-8597-9fcc3e840e25/node-ca/0.log"
Jul 07 17:00:15.832154 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:15.832130    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cg6b4_f4a3b7d0-4d2f-4c49-8687-e1d474a09362/payload-pre-processing/0.log"
Jul 07 17:00:15.882197 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:15.882169    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9s4tz_cd29c741-6eed-4d29-9c79-9317747a527f/payload-processing/0.log"
Jul 07 17:00:15.908517 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:15.908495    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc9946d6c-2zf4h_3fbe5de2-adb7-4c64-917e-224067117816/router/0.log"
Jul 07 17:00:16.685549 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:16.685522    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hsg7w_eea8e3d9-c509-42ed-b99a-30b220afc51f/serve-healthcheck-canary/0.log"
Jul 07 17:00:17.399561 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:17.399536    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8wtm_c0c04353-6371-40d0-823e-d862fe3af16b/kube-rbac-proxy/0.log"
Jul 07 17:00:17.426107 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:17.426085    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8wtm_c0c04353-6371-40d0-823e-d862fe3af16b/exporter/0.log"
Jul 07 17:00:17.453167 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:17.453139    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x8wtm_c0c04353-6371-40d0-823e-d862fe3af16b/extractor/0.log"
Jul 07 17:00:17.781363 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:17.781286    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-mzzlb"
Jul 07 17:00:20.401057 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.401023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7cdfbbc57c-t7hm7_c2f23e7d-7c02-4765-b010-7f6ab220dd6d/maas-api/0.log"
Jul 07 17:00:20.425207 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.425183    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724030-vgxlq_2e365a39-505a-4dce-98b1-c2e9e5f32d4e/cleanup/0.log"
Jul 07 17:00:20.456754 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.456734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724045-dzmzv_6d10cdcc-790d-4627-bfee-3629948ea07c/cleanup/0.log"
Jul 07 17:00:20.487212 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.487185    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724060-g2vcr_dc764d1f-6e92-41e4-bab0-a17e2d0d8820/cleanup/0.log"
Jul 07 17:00:20.594887 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.594855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d97f49c6-srzwm_d5d32387-f9b2-40ce-a3c8-2190a9c34242/manager/0.log"
Jul 07 17:00:20.924872 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.924845    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-vgt4j_ed8a6902-f025-40ea-94b7-ab141dad306a/manager/0.log"
Jul 07 17:00:20.948433 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.948409    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-vgt4j_ed8a6902-f025-40ea-94b7-ab141dad306a/copy-manifests/0.log"
Jul 07 17:00:20.976214 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:20.976193    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hsppn_3b7cb6cd-f7d6-4060-a0d4-83ed78d688af/postgres/0.log"
Jul 07 17:00:21.462542 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:21.462513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cg6b4_f4a3b7d0-4d2f-4c49-8687-e1d474a09362/payload-pre-processing/0.log"
Jul 07 17:00:21.505606 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:21.505578    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9s4tz_cd29c741-6eed-4d29-9c79-9317747a527f/payload-processing/0.log"
Jul 07 17:00:21.518532 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:21.518513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc9946d6c-2zf4h_3fbe5de2-adb7-4c64-917e-224067117816/router/0.log"
Jul 07 17:00:22.390468 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:22.390431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cb66b9dcc-gpj8j_e9f7d01e-0276-439f-8473-6e1c3443d315/manager/0.log"
Jul 07 17:00:22.911878 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:22.911850    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-cg6b4_f4a3b7d0-4d2f-4c49-8687-e1d474a09362/payload-pre-processing/0.log"
Jul 07 17:00:22.952891 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:22.952867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9s4tz_cd29c741-6eed-4d29-9c79-9317747a527f/payload-processing/0.log"
Jul 07 17:00:22.969136 ip-10-0-135-243 kubenswrapper[2573]: I0707 17:00:22.969110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bc9946d6c-2zf4h_3fbe5de2-adb7-4c64-917e-224067117816/router/0.log"