Jul 03 15:11:11.668414 ip-10-0-138-243 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 03 15:11:11.668565 ip-10-0-138-243 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 03 15:11:11.668645 ip-10-0-138-243 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 03 15:11:11.668925 ip-10-0-138-243 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 03 15:11:21.809885 ip-10-0-138-243 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 03 15:11:21.809900 ip-10-0-138-243 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 186a192d1fa14d0cbe4a65a325a05c53 --
Jul 03 15:13:19.422654 ip-10-0-138-243 systemd[1]: Starting Kubernetes Kubelet...
Jul 03 15:13:19.757357 ip-10-0-138-243 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 15:13:19.757357 ip-10-0-138-243 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 03 15:13:19.757357 ip-10-0-138-243 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 15:13:19.757357 ip-10-0-138-243 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 03 15:13:19.757357 ip-10-0-138-243 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 15:13:19.758797 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.758705    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 03 15:13:19.763499 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763479    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 15:13:19.763499 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763499    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763503    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763507    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763510    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763513    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763520    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763523    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763526    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763529    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763531    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763534    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763538    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763541    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763543    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763545    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763549    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763552    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763555    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763557    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763560    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 15:13:19.763569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763563    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763565    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763568    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763597    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763601    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763606    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763610    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763613    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763616    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763623    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763627    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763631    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763634    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763636    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763641    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763644    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763646    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763649    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763652    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 15:13:19.764052 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763654    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763657    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763659    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763662    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763664    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763667    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763669    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763671    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763674    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763676    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763678    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763680    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763683    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763685    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763687    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763691    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763694    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763696    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763699    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763702    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 15:13:19.764528 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763704    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763706    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763710    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763713    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763715    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763718    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763720    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763723    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763725    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763728    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763730    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763733    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763736    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763738    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763740    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763743    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763745    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763747    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763750    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 15:13:19.765015 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763752    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763755    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763757    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763759    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763762    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763764    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763767    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763769    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763772    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763775    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763777    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763780    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763782    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763786    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763790    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763792    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763795    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763798    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763800    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.763802    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 15:13:19.765491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764544    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764552    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764558    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764562    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764566    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764570    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764573    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764576    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764579    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764581    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764584    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764586    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764589    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764592    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764594    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764596    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764599    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764601    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764604    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 15:13:19.765970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764606    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764609    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764612    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764615    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764617    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764620    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764623    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764625    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764628    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764631    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764633    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764637    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764639    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764642    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764645    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764647    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764650    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764652    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764655    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764657    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 15:13:19.766492 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764660    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764663    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764665    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764668    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764671    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764673    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764675    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764678    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764680    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764683    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764686    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764688    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764691    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764696    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764698    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764702    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764704    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764707    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764710    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764713    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 15:13:19.766984 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764715    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764717    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764720    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764722    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764724    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764727    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764729    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764732    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764734    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764737    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764739    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764742    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764744    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764747    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764750    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764752    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764755    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764757    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764759    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 15:13:19.767485 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764762    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764764    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764767    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764769    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764772    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764774    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764777    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764780    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764782    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764785    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764787    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764790    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764792    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764794    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764797    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764799    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764802    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764806    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764808    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764810    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 15:13:19.767941 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.764813    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765224    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765232    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765238    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765242    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765244    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765249    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765251    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765254    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765257    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765259    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765261    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765264    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765267    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765270    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765272    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765275    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765277    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765281    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765284    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 15:13:19.768477 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765287    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765289    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765292    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765294    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765299    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765302    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765307    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765312    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765317    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765320    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765322    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765326    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765330    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765333    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765336    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765338    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765343    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765346    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 15:13:19.768953 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765349    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765352    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765355    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765372    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765376    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765380    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765386    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765393    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765448    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765454    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765457    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765461    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765464    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765467    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765470    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765473    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765475    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765478    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765481    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 15:13:19.769394 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765483    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765486    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765489    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765492    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765494    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765497    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765499    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765502    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765505    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765508    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765510    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765513    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765515    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765518    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765520    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765523    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765526    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765528    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765531    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765533    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 15:13:19.769842 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765536    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765539    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765543    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765546    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765549    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765552    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765555    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765561    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765564    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765566    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765569    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765572    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765574    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765577    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765580    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765583    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765586    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765588    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765591    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765593    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 15:13:19.770444 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765596    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765598    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.765601    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765685    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765697    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765708    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765718    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765723    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765726    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765730    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765735    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765738    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765742    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765745    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765749    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765753    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765756    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765759    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765762    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765764    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765767    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765771    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765774    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 03 15:13:19.770921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765777    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765780    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765783    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765787    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765790    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765793    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765796    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765799    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765802    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765804    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765807    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765810    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765815    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765818    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765821    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765824    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765827    2579 flags.go:64] FLAG: --enable-server="true"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765829    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765834    2579 flags.go:64] FLAG: --event-burst="100"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765837    2579 flags.go:64] FLAG: --event-qps="50"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765840    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765843    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765846    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765851    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 03 15:13:19.771515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765854    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765864    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765867    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765870    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765872    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765875    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765878    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765881    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765884    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765886    2579 flags.go:64] FLAG: --feature-gates=""
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765895    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765898    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765901    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765904    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765907    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765910    2579 flags.go:64] FLAG: --help="false"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765913    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-243.ec2.internal"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765916    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765919    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765922    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765925    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765928    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765932    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 03 15:13:19.772099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765935    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765937    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765940    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765943    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765946    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765949    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765952    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765955    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765958    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765961    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765963    2579 flags.go:64] FLAG: --lock-file=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765967    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765969    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765973    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765978    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765981    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765984    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765987    2579 flags.go:64] FLAG: --logging-format="text"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765990    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765993    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765996    2579 flags.go:64] FLAG: --manifest-url=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.765998    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766003    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766006    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766010    2579 flags.go:64] FLAG: --max-pods="110"
Jul 03 15:13:19.772750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766013    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766016    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766022    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766025    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766028    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766031    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766034    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766042    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766046    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766048    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766051    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766054    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766060    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766063    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766067    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766070    2579 flags.go:64] FLAG: --port="10250"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766073    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766076    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d3da514389537c0"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766079    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766082    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766085    2579 flags.go:64] FLAG: --register-node="true"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766088    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766092    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766095    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 03 15:13:19.773559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766097    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766100    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766104    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766107    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766109    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766112    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766115    2579 flags.go:64] FLAG: --runonce="false"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766117    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766120    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766123    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766126    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766130    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766133    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766135    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766138    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766141    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766144    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766147    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766149    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766152    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766155    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766157    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766164    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766166    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766169    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 03 15:13:19.774351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766173    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766176    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766179    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766182    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766185    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766187    2579 flags.go:64] FLAG: --v="2"
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766191    2579 flags.go:64] FLAG: --version="false"
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766196    2579 flags.go:64] FLAG: --vmodule=""
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766199    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.766202    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766321    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766325    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766328    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766331    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766334    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766336    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766339    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766341    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766345    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766348    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766351    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766354    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 15:13:19.774998 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766356    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766373    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766377    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766382    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766386    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766391    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766394    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766398    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766401    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766404    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766406    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766408    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766411    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766414    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766418    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766420    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766424    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766426    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766428    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766431    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 15:13:19.775591 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766433    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766436    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766439    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766441    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766443    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766446    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766450    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766454    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766458    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766460    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766463    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766465    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766468    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766471    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766473    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766475    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766478    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766481    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766483    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 15:13:19.776097 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766489    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766492    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766496    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766499    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766503    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766506    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766509    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766511    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766514    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766517    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766519    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766522    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766525    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766527    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766530    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766533    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766535    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766538    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766540    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 15:13:19.776575 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766543    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766545    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766549    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766551    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766554    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766556    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766558    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766562    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766564    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766566    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766569    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766571    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766573    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766577    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766579    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766582    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766585    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766589    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766592    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766594    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 15:13:19.777039 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766597    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766599    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766603    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766605    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766608    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766610    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766613    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766615    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.766618    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.767093    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.775381    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.775399    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.776033    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.776053    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776112    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 15:13:19.777547 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776117    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776122    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776127    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776130    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776133    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776136    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776139    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776141    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776144    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776146    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776149    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776151    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776154    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776156    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776159    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776161    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776164    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776166    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776169    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 15:13:19.777915 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776171    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776179    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776181    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776184    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776187    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776189    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776192    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776195    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776197    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776200    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776203    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776205    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776208    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776211    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776213    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776216    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776219    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776222    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776224    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776227    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 15:13:19.778386 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776229    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776232    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776234    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776238    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776241    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776244    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776247    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776249    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776252    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776255    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776258    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776260    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776263    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776265    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776268    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776270    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776272    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776275    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776278    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 15:13:19.778872 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776281    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776283    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776286    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776289    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776292    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776294    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776297    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776299    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776302    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776304    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776306    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776309    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776311    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776314    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776316    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776319    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776321    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776323    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776326    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776328    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 15:13:19.779334 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776332    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776334    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776337    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776339    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776342    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776344    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776347    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776349    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776351    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776355    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776381    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776385    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776387    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776390    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776393    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776395    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776398    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776401    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776403    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 15:13:19.779835 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776406    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.776411    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776531    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776537    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776540    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776542    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776545    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776548    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776551    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776554    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776556    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776559    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776562    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776564    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776568    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 15:13:19.780321 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776571    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776573    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776576    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776579    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776581    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776584    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776586    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776590    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776592    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776594    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776597    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776599    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776602    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776604    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776607    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776609    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776611    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776614    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776616    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776619    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 15:13:19.780703 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776621    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776624    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776626    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776628    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776631    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776633    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776636    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776638    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776640    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776643    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776645    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776648    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776651    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776654    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776656    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776658    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776661    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776663    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776665    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776668    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 15:13:19.781183 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776670    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776672    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776675    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776678    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776680    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776683    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776685    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776688    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776690    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776693    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776695    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776698    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776702    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776705    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776707    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776710    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776712    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776714    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776717    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 15:13:19.781678 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776719    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776722    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776725    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776729    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776731    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776734    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776737    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776740    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776742    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776744    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776747    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776750    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776752    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776754    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776757    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776760    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776762    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776765    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776767    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776769    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 15:13:19.782139 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776772    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776774    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776778    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776781    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776784    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776787    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:19.776790    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.776794    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.776909    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.779618    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.780797    2579 server.go:1019] "Starting client certificate rotation"
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.780906    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 15:13:19.782642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.780947    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 15:13:19.782954 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.782934    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 15:13:19.784191 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.784175    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 15:13:19.793540 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.793521    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 03 15:13:19.796533 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.796516    2579 log.go:25] "Validated CRI v1 image API"
Jul 03 15:13:19.797898 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.797871    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 03 15:13:19.800702 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.800684    2579 fs.go:135] Filesystem UUIDs: map[08a8217a-0b81-4707-a48b-59179e71415d:/dev/nvme0n1p3 206cb465-e855-4d38-8f9f-3570b44b7ce8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 03 15:13:19.800749 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.800703    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 03 15:13:19.805608 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.805488    2579 manager.go:216] Machine: {Timestamp:2026-07-03 15:13:19.804245333 +0000 UTC m=+0.278426929 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101726 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ecac4c3f5722f4b553e0467ab2a6 SystemUUID:ec25ecac-4c3f-5722-f4b5-53e0467ab2a6 BootID:186a192d-1fa1-4d0c-be4a-65a325a05c53 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:68:af:0c:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:68:af:0c:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:49:2e:29:23:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 03 15:13:19.805608 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.805600    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 03 15:13:19.805740 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.805712    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 03 15:13:19.808180 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.808148    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 03 15:13:19.808313 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.808180    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 03 15:13:19.808771 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.808760    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 03 15:13:19.808804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.808774    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 03 15:13:19.808804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.808782    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 15:13:19.809356 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.809344    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 15:13:19.809482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.809466    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 15:13:19.810570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.810559    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 03 15:13:19.814118 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814103    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 15:13:19.814426 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814415    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 03 15:13:19.814474 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814449    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 03 15:13:19.814474 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814460    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 03 15:13:19.814474 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814473    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 03 15:13:19.814585 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814482    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 03 15:13:19.814585 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814491    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 03 15:13:19.814863 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814842    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 15:13:19.814982 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.814870    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 15:13:19.816847 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.816827    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 03 15:13:19.818680 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.818666    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 03 15:13:19.818741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.818697    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 03 15:13:19.820002 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.819990    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820007    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820014    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820019    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820028    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820041    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820051    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820057    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820063    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 03 15:13:19.820068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820069    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 03 15:13:19.820424 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820078    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 03 15:13:19.820424 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820084    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 03 15:13:19.820720 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820710    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 03 15:13:19.820720 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.820720    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 03 15:13:19.823524 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.823505    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 03 15:13:19.824099 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.824071    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 03 15:13:19.824099 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.824074    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 03 15:13:19.824224 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.824170    2579 server.go:1268] "Started kubelet"
Jul 03 15:13:19.824270 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.824239    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 03 15:13:19.824356 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.824314    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 03 15:13:19.824415 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.824398    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 03 15:13:19.826051 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.825896    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 03 15:13:19.826580 ip-10-0-138-243 systemd[1]: Started Kubernetes Kubelet.
Jul 03 15:13:19.826718 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.826711    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 03 15:13:19.828203 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.828185    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ggl5k"
Jul 03 15:13:19.829583 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.829562    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 03 15:13:19.829983 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.829232    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-243.ec2.internal.18bed05ce18056ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-243.ec2.internal,UID:ip-10-0-138-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-243.ec2.internal,},FirstTimestamp:2026-07-03 15:13:19.824148154 +0000 UTC m=+0.298329750,LastTimestamp:2026-07-03 15:13:19.824148154 +0000 UTC m=+0.298329750,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-243.ec2.internal,}"
Jul 03 15:13:19.831938 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.831922    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 03 15:13:19.832026 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.831943    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 03 15:13:19.832026 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.831994    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:19.832582 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.832562    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 03 15:13:19.832688 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.832606    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 03 15:13:19.832688 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.832619    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 03 15:13:19.832801 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.832692    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 03 15:13:19.832801 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.832702    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 03 15:13:19.833520 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833501    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 03 15:13:19.833520 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833521    2579 factory.go:55] Registering systemd factory
Jul 03 15:13:19.833619 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833531    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 03 15:13:19.833775 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833762    2579 factory.go:153] Registering CRI-O factory
Jul 03 15:13:19.833831 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833778    2579 factory.go:223] Registration of the crio container factory successfully
Jul 03 15:13:19.833831 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833796    2579 factory.go:103] Registering Raw factory
Jul 03 15:13:19.833831 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.833805    2579 manager.go:1196] Started watching for new ooms in manager
Jul 03 15:13:19.834113 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.834103    2579 manager.go:349] Starting recovery of all containers
Jul 03 15:13:19.835763 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.835735    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ggl5k"
Jul 03 15:13:19.841845 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.841812    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 03 15:13:19.842084 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.842057    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 03 15:13:19.846341 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.846317    2579 manager.go:354] Recovery completed
Jul 03 15:13:19.850880 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.850868    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:19.852779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.852762    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:19.852824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.852794    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:19.852824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.852805    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:19.853351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.853336    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 03 15:13:19.853430 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.853351    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 03 15:13:19.853430 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.853387    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 15:13:19.853430 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.853389    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:19.854051 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.854036    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:19.854127 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.854062    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:19.854127 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.854073    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:19.855555 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.855544    2579 policy_none.go:49] "None policy: Start"
Jul 03 15:13:19.855594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.855560    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 03 15:13:19.855594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.855570    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 03 15:13:19.857543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.857532    2579 policy_none.go:47] "Start"
Jul 03 15:13:19.892951 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.892935    2579 manager.go:337] "Starting Device Plugin manager"
Jul 03 15:13:19.893048 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.893001    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 03 15:13:19.893048 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.893016    2579 server.go:87] "Starting device plugin registration server"
Jul 03 15:13:19.893303 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.893287    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 03 15:13:19.893379 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.893307    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 03 15:13:19.893420 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.893406    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 03 15:13:19.893533 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.893517    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 03 15:13:19.893587 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.893533    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 03 15:13:19.894018 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.893997    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 03 15:13:19.894108 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:19.894050    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:19.993870 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.993835    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:19.996112 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.994901    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:19.996112 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.994933    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:19.996112 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.994951    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:19.996112 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:19.994987    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.002031 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.002004    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 03 15:13:20.002492 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.002479    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.002568 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.002501    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-243.ec2.internal\": node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.003502 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.003483    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 03 15:13:20.003596 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.003528    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 03 15:13:20.003596 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.003549    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 03 15:13:20.003596 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.003580    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 03 15:13:20.005224 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.005205    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:20.044638 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.044558    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.104681 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.104645    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"]
Jul 03 15:13:20.104826 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.104731    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:20.106373 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.106333    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:20.106490 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.106383    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:20.106490 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.106399    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:20.108771 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.108758    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:20.108891 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.108877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.108935 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.108922    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:20.109512 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.109494    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:20.109610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.109523    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:20.109610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.109532    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:20.109610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.109499    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:20.109702 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.109614    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:20.109702 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.109627    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:20.111738 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.111725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.111784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.111749    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 15:13:20.112457 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.112435    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 15:13:20.112562 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.112463    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 15:13:20.112562 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.112473    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeHasSufficientPID"
Jul 03 15:13:20.134770 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.134743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff4e189349337a51c894b8e09bd7410c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal\" (UID: \"ff4e189349337a51c894b8e09bd7410c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.134770 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.134772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff4e189349337a51c894b8e09bd7410c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal\" (UID: \"ff4e189349337a51c894b8e09bd7410c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.134927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.134789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e37f959504a10a7ebf5cd6917814e2e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-243.ec2.internal\" (UID: \"0e37f959504a10a7ebf5cd6917814e2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.144168 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.144144    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-243.ec2.internal\" not found" node="ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.144888 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.144870    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.148718 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.148702    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-243.ec2.internal\" not found" node="ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.235307 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.235262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff4e189349337a51c894b8e09bd7410c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal\" (UID: \"ff4e189349337a51c894b8e09bd7410c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.235307 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.235305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff4e189349337a51c894b8e09bd7410c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal\" (UID: \"ff4e189349337a51c894b8e09bd7410c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.235307 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.235320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e37f959504a10a7ebf5cd6917814e2e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-243.ec2.internal\" (UID: \"0e37f959504a10a7ebf5cd6917814e2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.235576 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.235382    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff4e189349337a51c894b8e09bd7410c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal\" (UID: \"ff4e189349337a51c894b8e09bd7410c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.235576 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.235395    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e37f959504a10a7ebf5cd6917814e2e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-243.ec2.internal\" (UID: \"0e37f959504a10a7ebf5cd6917814e2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.235576 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.235399    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff4e189349337a51c894b8e09bd7410c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal\" (UID: \"ff4e189349337a51c894b8e09bd7410c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.245408 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.245385    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.346232 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.346157    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.446741 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.446711    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.446741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.446713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.451765 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.451575    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.547016 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.546975    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.647548 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.647482    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-243.ec2.internal\" not found"
Jul 03 15:13:20.692697 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.692668    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:20.732091 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.732064    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.742468 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.742446    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 15:13:20.743721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.743703    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:20.743951 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.743937    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal"
Jul 03 15:13:20.749098 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.749080    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 15:13:20.780302 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.780273    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 03 15:13:20.780961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.780468    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 15:13:20.780961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.780481    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 15:13:20.780961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.780471    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 15:13:20.815602 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.815573    2579 apiserver.go:52] "Watching apiserver"
Jul 03 15:13:20.832081 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.832050    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 03 15:13:20.833493 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.833475    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 03 15:13:20.835348 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.835327    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal","openshift-multus/multus-additional-cni-plugins-wpmcz","openshift-multus/multus-xllhm","openshift-multus/network-metrics-daemon-rf68h","openshift-network-diagnostics/network-check-target-df46w","kube-system/konnectivity-agent-swtq4","kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal","openshift-cluster-node-tuning-operator/tuned-h5wq2","openshift-dns/node-resolver-nm97r","openshift-image-registry/node-ca-bz4g4","openshift-network-operator/iptables-alerter-mptlm","openshift-ovn-kubernetes/ovnkube-node-glj6t","kube-system/global-pull-secret-syncer-kfqtr"]
Jul 03 15:13:20.837860 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.837845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:20.840090 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.840065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.840859 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.840841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dp8lw\""
Jul 03 15:13:20.840859 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.840855    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 03 15:13:20.841020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.840841    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 03 15:13:20.841020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.840894    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 15:08:20 +0000 UTC" deadline="2028-03-08 12:19:25.478782935 +0000 UTC"
Jul 03 15:13:20.841020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.840935    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14733h6m4.637851608s"
Jul 03 15:13:20.842176 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.842159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.842626 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.842605    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.842726 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.842603    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.842839 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.842821    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ghdbc\""
Jul 03 15:13:20.843059 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.843042    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 03 15:13:20.843132 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.843112    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 03 15:13:20.843188 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.843165    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 03 15:13:20.843241 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.843213    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 03 15:13:20.844783 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.844766    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.844886 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.844869    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b2jfc\""
Jul 03 15:13:20.844927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.844869    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 03 15:13:20.845016 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.845001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.845168 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.845149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.845239 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.845220    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 03 15:13:20.845277 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.845237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 03 15:13:20.845648 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.845632    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 15:13:20.847300 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.847285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:20.847398 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.847348    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:20.847933 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.847911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vnznm\""
Jul 03 15:13:20.848017 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.847921    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 03 15:13:20.850183 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.850162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:20.850265 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.850227    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:20.852339 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.852319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.854850 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.854832    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.855169 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.854986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wsmd\""
Jul 03 15:13:20.855169 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.855066    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.855169 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.855086    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.857786 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.857472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:20.857786 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:20.857537    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:20.857786 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.857578    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.857786 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.857575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 03 15:13:20.857786 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.857613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.858199 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.857941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcjpp\""
Jul 03 15:13:20.861872 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.861850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:20.864214 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.864193    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.864314 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.864273    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.864314 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.864282    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fw27\""
Jul 03 15:13:20.864592 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.864579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:20.867065 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.867043    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 03 15:13:20.867161 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.867047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-64pm7\""
Jul 03 15:13:20.867161 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.867074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.867246 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.867189    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.867860 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.867844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:20.870275 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.870254    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 03 15:13:20.870349 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.870284    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 03 15:13:20.870406 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.870284    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6zjcr\""
Jul 03 15:13:20.870551 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.870538    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 03 15:13:20.876633 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.876618    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdn2w"
Jul 03 15:13:20.885669 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.885646    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdn2w"
Jul 03 15:13:20.925604 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.925582    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:20.934073 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.934053    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 03 15:13:20.938506 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-tmp-dir\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:20.938622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/980edf0e-cf08-4ffe-9bba-a2b46600c962-host-slash\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:20.938622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-run-netns\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.938622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.938622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-cni-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.938622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-daemon-config\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s849\" (UniqueName: \"kubernetes.io/projected/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-kube-api-access-2s849\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-kubernetes\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-systemd\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-tuned\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-log-socket\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cnibin\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-cni-bin\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-cni-multus\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-kubelet-config\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:20.938906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqw7\" (UniqueName: \"kubernetes.io/projected/980edf0e-cf08-4ffe-9bba-a2b46600c962-kube-api-access-skqw7\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-kubelet\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovnkube-config\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-os-release\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.938997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-k8s-cni-cncf-io\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-modprobe-d\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnnc9\" (UniqueName: \"kubernetes.io/projected/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-kube-api-access-vnnc9\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-netns\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-lib-modules\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939159    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-var-lib-kubelet\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6xzx\" (UniqueName: \"kubernetes.io/projected/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-kube-api-access-n6xzx\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/980edf0e-cf08-4ffe-9bba-a2b46600c962-iptables-alerter-script\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-node-log\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovn-node-metrics-cert\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.939594 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-kubelet\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29831fb7-b939-4bf4-94c0-05738c0b9bc8-tmp\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc924\" (UniqueName: \"kubernetes.io/projected/29831fb7-b939-4bf4-94c0-05738c0b9bc8-kube-api-access-pc924\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-socket-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-ovn\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-cni-bin\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-system-cni-dir\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-cnibin\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0261fda3-060d-41e8-8a08-ef2deea6ca5a-agent-certs\") pod \"konnectivity-agent-swtq4\" (UID: \"0261fda3-060d-41e8-8a08-ef2deea6ca5a\") " pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/022d0d05-74fc-49bc-8687-223939b898d1-host\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovnkube-script-lib\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-cni-binary-copy\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-hostroot\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.939905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nhz4\" (UniqueName: \"kubernetes.io/projected/d1ce76a1-680f-4770-8e68-5b152eda3ccb-kube-api-access-5nhz4\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-sys\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-systemd-units\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j47mf\" (UniqueName: \"kubernetes.io/projected/022d0d05-74fc-49bc-8687-223939b898d1-kube-api-access-j47mf\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-systemd\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqlrs\" (UniqueName: \"kubernetes.io/projected/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-kube-api-access-hqlrs\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-system-cni-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.940791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-device-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-hosts-file\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-slash\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-socket-dir-parent\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysctl-d\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-run\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.940994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-registration-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-sys-fs\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/022d0d05-74fc-49bc-8687-223939b898d1-serviceca\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:20.941087 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-dbus\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-var-lib-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-cni-netd\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-etc-kubernetes\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941196    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysconfig\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0261fda3-060d-41e8-8a08-ef2deea6ca5a-konnectivity-ca\") pod \"konnectivity-agent-swtq4\" (UID: \"0261fda3-060d-41e8-8a08-ef2deea6ca5a\") " pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-etc-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-multus-certs\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-conf-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-env-overrides\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphfc\" (UniqueName: \"kubernetes.io/projected/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-kube-api-access-wphfc\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-os-release\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysctl-conf\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:20.941481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:20.941455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-host\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.034320 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.034282    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4e189349337a51c894b8e09bd7410c.slice/crio-4497198c938969d4b233a40dac7cb1600eeb9a79dada0ee70ee8368a7edcad15 WatchSource:0}: Error finding container 4497198c938969d4b233a40dac7cb1600eeb9a79dada0ee70ee8368a7edcad15: Status 404 returned error can't find the container with id 4497198c938969d4b233a40dac7cb1600eeb9a79dada0ee70ee8368a7edcad15
Jul 03 15:13:21.039373 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.039353    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 15:13:21.042218 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-log-socket\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.042218 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cnibin\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.042418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042307    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cnibin\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.042418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042306    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-log-socket\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.042418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.042418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-cni-bin\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-cni-multus\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-kubelet-config\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skqw7\" (UniqueName: \"kubernetes.io/projected/980edf0e-cf08-4ffe-9bba-a2b46600c962-kube-api-access-skqw7\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-kubelet\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042523    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-cni-multus\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovnkube-config\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-os-release\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-k8s-cni-cncf-io\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-modprobe-d\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.042694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnnc9\" (UniqueName: \"kubernetes.io/projected/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-kube-api-access-vnnc9\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-netns\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-lib-modules\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-var-lib-kubelet\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042808    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-kubelet-config\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6xzx\" (UniqueName: \"kubernetes.io/projected/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-kube-api-access-n6xzx\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042951    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-os-release\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043020    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-kubelet\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/980edf0e-cf08-4ffe-9bba-a2b46600c962-iptables-alerter-script\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-node-log\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043069    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovn-node-metrics-cert\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-kubelet\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29831fb7-b939-4bf4-94c0-05738c0b9bc8-tmp\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc924\" (UniqueName: \"kubernetes.io/projected/29831fb7-b939-4bf4-94c0-05738c0b9bc8-kube-api-access-pc924\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043247    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.043259 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-socket-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043282    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-k8s-cni-cncf-io\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043320    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-var-lib-kubelet\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-ovn\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-cni-bin\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-node-log\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-system-cni-dir\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043459    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-kubelet\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-netns\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043575    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-socket-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043638    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-lib-modules\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043657    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/980edf0e-cf08-4ffe-9bba-a2b46600c962-iptables-alerter-script\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.043675    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043735    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043695    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043780    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovnkube-config\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043802    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-ovn\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.044192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043876    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-cni-bin\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.042887    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-modprobe-d\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-cnibin\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0261fda3-060d-41e8-8a08-ef2deea6ca5a-agent-certs\") pod \"konnectivity-agent-swtq4\" (UID: \"0261fda3-060d-41e8-8a08-ef2deea6ca5a\") " pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043948    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-system-cni-dir\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.043959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/022d0d05-74fc-49bc-8687-223939b898d1-host\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044005    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-cnibin\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044010    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/022d0d05-74fc-49bc-8687-223939b898d1-host\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.044026    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:21.543989436 +0000 UTC m=+2.018171025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovnkube-script-lib\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-cni-binary-copy\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-hostroot\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nhz4\" (UniqueName: \"kubernetes.io/projected/d1ce76a1-680f-4770-8e68-5b152eda3ccb-kube-api-access-5nhz4\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-sys\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044239    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-hostroot\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.045139 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-systemd-units\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044389    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-var-lib-cni-bin\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044474    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.044478    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-systemd-units\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.044539    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:13:21.544518333 +0000 UTC m=+2.018699922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044561    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-sys\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j47mf\" (UniqueName: \"kubernetes.io/projected/022d0d05-74fc-49bc-8687-223939b898d1-kube-api-access-j47mf\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-systemd\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqlrs\" (UniqueName: \"kubernetes.io/projected/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-kube-api-access-hqlrs\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044697    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovnkube-script-lib\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-system-cni-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-device-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-hosts-file\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-slash\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-socket-dir-parent\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-cni-binary-copy\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysctl-d\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-run\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.044988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-run-systemd\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045011    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysctl-d\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-registration-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045037    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-sys-fs\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045064    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-run\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/022d0d05-74fc-49bc-8687-223939b898d1-serviceca\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045074    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-registration-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045103    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-system-cni-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-device-dir\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045143    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-hosts-file\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045150    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-sys-fs\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.046991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045185    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-slash\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045201    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-cni-binary-copy\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045205    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-socket-dir-parent\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-dbus\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045471    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-dbus\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045486    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-var-lib-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-var-lib-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045513    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-cni-netd\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-etc-kubernetes\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045642    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-cni-netd\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysconfig\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045743    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/022d0d05-74fc-49bc-8687-223939b898d1-serviceca\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0261fda3-060d-41e8-8a08-ef2deea6ca5a-konnectivity-ca\") pod \"konnectivity-agent-swtq4\" (UID: \"0261fda3-060d-41e8-8a08-ef2deea6ca5a\") " pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-etc-kubernetes\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045804    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysconfig\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.047856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-etc-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-multus-certs\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045859    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-etc-openvswitch\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-conf-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-env-overrides\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045908    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-host-run-multus-certs\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphfc\" (UniqueName: \"kubernetes.io/projected/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-kube-api-access-wphfc\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045954    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-conf-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.045954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-os-release\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysctl-conf\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-host\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046012    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-os-release\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-tmp-dir\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046463    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-env-overrides\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0261fda3-060d-41e8-8a08-ef2deea6ca5a-konnectivity-ca\") pod \"konnectivity-agent-swtq4\" (UID: \"0261fda3-060d-41e8-8a08-ef2deea6ca5a\") " pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.046265    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e37f959504a10a7ebf5cd6917814e2e.slice/crio-7a728d4dcdcb60c371f7d632bde73be767ee9ebae3a69994b7d21b2a6ab43d2e WatchSource:0}: Error finding container 7a728d4dcdcb60c371f7d632bde73be767ee9ebae3a69994b7d21b2a6ab43d2e: Status 404 returned error can't find the container with id 7a728d4dcdcb60c371f7d632bde73be767ee9ebae3a69994b7d21b2a6ab43d2e
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/980edf0e-cf08-4ffe-9bba-a2b46600c962-host-slash\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.048777 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046674    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/980edf0e-cf08-4ffe-9bba-a2b46600c962-host-slash\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-run-netns\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046766    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-run-netns\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-sysctl-conf\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-cni-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-daemon-config\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046891    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046913    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-host\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s849\" (UniqueName: \"kubernetes.io/projected/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-kube-api-access-2s849\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.046975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-kubernetes\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-systemd\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-tuned\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047101    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-tmp-dir\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047194    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-kubernetes\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047252    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-cni-dir\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047356    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-systemd\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049345 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047430    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-multus-daemon-config\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.049988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047516    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-ovn-node-metrics-cert\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.049988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.047549    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.049988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.048103    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29831fb7-b939-4bf4-94c0-05738c0b9bc8-tmp\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.049988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.048160    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0261fda3-060d-41e8-8a08-ef2deea6ca5a-agent-certs\") pod \"konnectivity-agent-swtq4\" (UID: \"0261fda3-060d-41e8-8a08-ef2deea6ca5a\") " pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:21.049988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.049552    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29831fb7-b939-4bf4-94c0-05738c0b9bc8-etc-tuned\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.056950 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.055663    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:21.056950 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.055689    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:21.056950 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.055703    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:21.056950 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.055995    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:21.555973368 +0000 UTC m=+2.030154956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:21.057523 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.057495    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqw7\" (UniqueName: \"kubernetes.io/projected/980edf0e-cf08-4ffe-9bba-a2b46600c962-kube-api-access-skqw7\") pod \"iptables-alerter-mptlm\" (UID: \"980edf0e-cf08-4ffe-9bba-a2b46600c962\") " pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.057616 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.057543    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j47mf\" (UniqueName: \"kubernetes.io/projected/022d0d05-74fc-49bc-8687-223939b898d1-kube-api-access-j47mf\") pod \"node-ca-bz4g4\" (UID: \"022d0d05-74fc-49bc-8687-223939b898d1\") " pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.058397 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.058372    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc924\" (UniqueName: \"kubernetes.io/projected/29831fb7-b939-4bf4-94c0-05738c0b9bc8-kube-api-access-pc924\") pod \"tuned-h5wq2\" (UID: \"29831fb7-b939-4bf4-94c0-05738c0b9bc8\") " pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.058563 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.058538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nhz4\" (UniqueName: \"kubernetes.io/projected/d1ce76a1-680f-4770-8e68-5b152eda3ccb-kube-api-access-5nhz4\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:21.058707 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.058689    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6xzx\" (UniqueName: \"kubernetes.io/projected/8e3fd46e-e025-430b-98fe-4e6e75e5b89d-kube-api-access-n6xzx\") pod \"aws-ebs-csi-driver-node-8c4rv\" (UID: \"8e3fd46e-e025-430b-98fe-4e6e75e5b89d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.058951 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.058932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s849\" (UniqueName: \"kubernetes.io/projected/1c2f861c-a8a3-4fbe-82db-a799615d3f9c-kube-api-access-2s849\") pod \"multus-xllhm\" (UID: \"1c2f861c-a8a3-4fbe-82db-a799615d3f9c\") " pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.059359 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.059336    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnnc9\" (UniqueName: \"kubernetes.io/projected/a31732f9-d018-4dcb-9801-f08e5a7a0d7b-kube-api-access-vnnc9\") pod \"node-resolver-nm97r\" (UID: \"a31732f9-d018-4dcb-9801-f08e5a7a0d7b\") " pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.060406 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.060382    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphfc\" (UniqueName: \"kubernetes.io/projected/a6c97aa9-ad65-41f0-9ddc-d2287826fabd-kube-api-access-wphfc\") pod \"multus-additional-cni-plugins-wpmcz\" (UID: \"a6c97aa9-ad65-41f0-9ddc-d2287826fabd\") " pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.060505 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.060382    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqlrs\" (UniqueName: \"kubernetes.io/projected/08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0-kube-api-access-hqlrs\") pod \"ovnkube-node-glj6t\" (UID: \"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.157990 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.157956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:21.168983 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.168959    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0261fda3_060d_41e8_8a08_ef2deea6ca5a.slice/crio-1fe4aaacd07f74301cc068ef4c111fec23e3d542f6d8f445e9bb588f7cd9ab91 WatchSource:0}: Error finding container 1fe4aaacd07f74301cc068ef4c111fec23e3d542f6d8f445e9bb588f7cd9ab91: Status 404 returned error can't find the container with id 1fe4aaacd07f74301cc068ef4c111fec23e3d542f6d8f445e9bb588f7cd9ab91
Jul 03 15:13:21.176176 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.176159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:21.183410 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.183390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv"
Jul 03 15:13:21.185706 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.185680    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a5e94c_b2c1_46b9_89e7_715a6cdcf4b0.slice/crio-946cc0a11ffa814d9df7590934b72773fe9b3036fe8ea083540031b5a527126f WatchSource:0}: Error finding container 946cc0a11ffa814d9df7590934b72773fe9b3036fe8ea083540031b5a527126f: Status 404 returned error can't find the container with id 946cc0a11ffa814d9df7590934b72773fe9b3036fe8ea083540031b5a527126f
Jul 03 15:13:21.193295 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.193079    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3fd46e_e025_430b_98fe_4e6e75e5b89d.slice/crio-8ccc92b136481dc80cacd7aa69417f0f25be1cc54c5845f7e906b6534a84498e WatchSource:0}: Error finding container 8ccc92b136481dc80cacd7aa69417f0f25be1cc54c5845f7e906b6534a84498e: Status 404 returned error can't find the container with id 8ccc92b136481dc80cacd7aa69417f0f25be1cc54c5845f7e906b6534a84498e
Jul 03 15:13:21.194238 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.194221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wpmcz"
Jul 03 15:13:21.205088 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.205064    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c97aa9_ad65_41f0_9ddc_d2287826fabd.slice/crio-0616878ee3c1e2b24cd4ac56d525f14c2e3966597542482507f8503cbf62436f WatchSource:0}: Error finding container 0616878ee3c1e2b24cd4ac56d525f14c2e3966597542482507f8503cbf62436f: Status 404 returned error can't find the container with id 0616878ee3c1e2b24cd4ac56d525f14c2e3966597542482507f8503cbf62436f
Jul 03 15:13:21.216418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.216385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xllhm"
Jul 03 15:13:21.225025 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.225001    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2f861c_a8a3_4fbe_82db_a799615d3f9c.slice/crio-00371390b32d524a05c6a5ca9d5fd22659c5d16f3c20ec1bf10788240c0e742f WatchSource:0}: Error finding container 00371390b32d524a05c6a5ca9d5fd22659c5d16f3c20ec1bf10788240c0e742f: Status 404 returned error can't find the container with id 00371390b32d524a05c6a5ca9d5fd22659c5d16f3c20ec1bf10788240c0e742f
Jul 03 15:13:21.240580 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.240556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h5wq2"
Jul 03 15:13:21.249431 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.249408    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29831fb7_b939_4bf4_94c0_05738c0b9bc8.slice/crio-b2c9d12b8dd7a91ae64010c3db8d61ecb1be02dab0594ddea5a69e35b90c8e4d WatchSource:0}: Error finding container b2c9d12b8dd7a91ae64010c3db8d61ecb1be02dab0594ddea5a69e35b90c8e4d: Status 404 returned error can't find the container with id b2c9d12b8dd7a91ae64010c3db8d61ecb1be02dab0594ddea5a69e35b90c8e4d
Jul 03 15:13:21.255743 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.255720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nm97r"
Jul 03 15:13:21.264417 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.264383    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31732f9_d018_4dcb_9801_f08e5a7a0d7b.slice/crio-4f9775b7a6c26385572ffac7e39341d6df54fd49e21c76e3b91e7078f780e5e8 WatchSource:0}: Error finding container 4f9775b7a6c26385572ffac7e39341d6df54fd49e21c76e3b91e7078f780e5e8: Status 404 returned error can't find the container with id 4f9775b7a6c26385572ffac7e39341d6df54fd49e21c76e3b91e7078f780e5e8
Jul 03 15:13:21.270872 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.270854    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bz4g4"
Jul 03 15:13:21.274666 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.274647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mptlm"
Jul 03 15:13:21.281138 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.281114    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022d0d05_74fc_49bc_8687_223939b898d1.slice/crio-5e97ffb073d08866cc2d5a6e5dbbf58360d4f9315cd53f7606d52dda4715db3b WatchSource:0}: Error finding container 5e97ffb073d08866cc2d5a6e5dbbf58360d4f9315cd53f7606d52dda4715db3b: Status 404 returned error can't find the container with id 5e97ffb073d08866cc2d5a6e5dbbf58360d4f9315cd53f7606d52dda4715db3b
Jul 03 15:13:21.283569 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:13:21.283546    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980edf0e_cf08_4ffe_9bba_a2b46600c962.slice/crio-7b91af39c637df0ad22c70284275e43eb03114915feed624d105aea875e8dc89 WatchSource:0}: Error finding container 7b91af39c637df0ad22c70284275e43eb03114915feed624d105aea875e8dc89: Status 404 returned error can't find the container with id 7b91af39c637df0ad22c70284275e43eb03114915feed624d105aea875e8dc89
Jul 03 15:13:21.553034 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.552844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:21.553034 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.552918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:21.553237 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.553060    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:21.553237 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.553114    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:21.553237 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.553137    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:13:22.553109255 +0000 UTC m=+3.027290855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:21.553237 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.553164    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:22.553144301 +0000 UTC m=+3.027325901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:21.623116 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.622869    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:21.654228 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.654185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:21.654510 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.654487    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:21.654665 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.654521    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:21.654665 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.654536    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:21.654665 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:21.654610    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:22.654587639 +0000 UTC m=+3.128769226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:21.889739 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.889597    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 15:08:21 +0000 UTC" deadline="2028-03-20 04:44:57.501359392 +0000 UTC"
Jul 03 15:13:21.889739 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:21.889673    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15013h31m35.611691022s"
Jul 03 15:13:22.009374 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.008635    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:22.009374 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.008790    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:22.009374 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.009228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:22.009374 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.009331    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:22.009985 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.009835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:22.009985 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.009946    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:22.039685 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.039622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h5wq2" event={"ID":"29831fb7-b939-4bf4-94c0-05738c0b9bc8","Type":"ContainerStarted","Data":"b2c9d12b8dd7a91ae64010c3db8d61ecb1be02dab0594ddea5a69e35b90c8e4d"}
Jul 03 15:13:22.050992 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.050948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv" event={"ID":"8e3fd46e-e025-430b-98fe-4e6e75e5b89d","Type":"ContainerStarted","Data":"8ccc92b136481dc80cacd7aa69417f0f25be1cc54c5845f7e906b6534a84498e"}
Jul 03 15:13:22.058710 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.058652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"946cc0a11ffa814d9df7590934b72773fe9b3036fe8ea083540031b5a527126f"}
Jul 03 15:13:22.070123 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.070037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swtq4" event={"ID":"0261fda3-060d-41e8-8a08-ef2deea6ca5a","Type":"ContainerStarted","Data":"1fe4aaacd07f74301cc068ef4c111fec23e3d542f6d8f445e9bb588f7cd9ab91"}
Jul 03 15:13:22.096140 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.096100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bz4g4" event={"ID":"022d0d05-74fc-49bc-8687-223939b898d1","Type":"ContainerStarted","Data":"5e97ffb073d08866cc2d5a6e5dbbf58360d4f9315cd53f7606d52dda4715db3b"}
Jul 03 15:13:22.101107 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.101056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nm97r" event={"ID":"a31732f9-d018-4dcb-9801-f08e5a7a0d7b","Type":"ContainerStarted","Data":"4f9775b7a6c26385572ffac7e39341d6df54fd49e21c76e3b91e7078f780e5e8"}
Jul 03 15:13:22.112566 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.112534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xllhm" event={"ID":"1c2f861c-a8a3-4fbe-82db-a799615d3f9c","Type":"ContainerStarted","Data":"00371390b32d524a05c6a5ca9d5fd22659c5d16f3c20ec1bf10788240c0e742f"}
Jul 03 15:13:22.136401 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.136360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerStarted","Data":"0616878ee3c1e2b24cd4ac56d525f14c2e3966597542482507f8503cbf62436f"}
Jul 03 15:13:22.150522 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.150366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal" event={"ID":"0e37f959504a10a7ebf5cd6917814e2e","Type":"ContainerStarted","Data":"7a728d4dcdcb60c371f7d632bde73be767ee9ebae3a69994b7d21b2a6ab43d2e"}
Jul 03 15:13:22.161615 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.161577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal" event={"ID":"ff4e189349337a51c894b8e09bd7410c","Type":"ContainerStarted","Data":"4497198c938969d4b233a40dac7cb1600eeb9a79dada0ee70ee8368a7edcad15"}
Jul 03 15:13:22.172836 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.172771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mptlm" event={"ID":"980edf0e-cf08-4ffe-9bba-a2b46600c962","Type":"ContainerStarted","Data":"7b91af39c637df0ad22c70284275e43eb03114915feed624d105aea875e8dc89"}
Jul 03 15:13:22.561415 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.561292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:22.561415 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.561364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:22.561664 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.561558    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:22.561664 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.561628    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:13:24.561606909 +0000 UTC m=+5.035788509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:22.562065 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.562046    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:22.562149 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.562102    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:24.562086594 +0000 UTC m=+5.036268186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:22.662567 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.662528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:22.662777 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.662718    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:22.662777 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.662762    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:22.662777 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.662776    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:22.662944 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:22.662838    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:24.662817568 +0000 UTC m=+5.136999176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:22.878874 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.878617    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:22.891610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.890246    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 15:08:21 +0000 UTC" deadline="2028-03-30 14:20:12.997174048 +0000 UTC"
Jul 03 15:13:22.891610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:22.890279    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15263h6m50.106898915s"
Jul 03 15:13:23.939086 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:23.939051    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 15:13:24.005783 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:24.005575    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:24.005783 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:24.005582    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:24.005783 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.005720    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:24.005783 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:24.005741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:24.006134 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.005859    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:24.006134 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.005940    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:24.582067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:24.581804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:24.582067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:24.581870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:24.582067 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.581961    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:24.582067 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.582003    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:24.582067 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.582050    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:28.582027545 +0000 UTC m=+9.056209156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:24.582569 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.582103    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:13:28.582087918 +0000 UTC m=+9.056269509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:24.682682 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:24.682643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:24.682930 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.682894    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:24.682930 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.682920    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:24.682930 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.682933    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:24.683207 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:24.682997    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:28.682978526 +0000 UTC m=+9.157160118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:26.005512 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:26.005453    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:26.005907 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:26.005867    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:26.016487 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:26.015520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:26.016487 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:26.015688    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:26.017114 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:26.017078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:26.018435 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:26.017345    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:28.004514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:28.004473    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:28.004514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:28.004503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:28.005050 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.004617    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:28.005113 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.005072    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:28.005169 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:28.005126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:28.005221 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.005206    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:28.620781 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:28.620740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:28.620991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:28.620842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:28.621059 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.620986    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:28.621059 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.621053    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:36.621032843 +0000 UTC m=+17.095214452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:28.621281 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.621254    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:28.621444 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.621315    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:13:36.621298564 +0000 UTC m=+17.095480149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:28.721931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:28.721888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:28.722100 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.722087    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:28.722146 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.722105    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:28.722146 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.722115    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:28.722217 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:28.722161    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:36.722147102 +0000 UTC m=+17.196328688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:30.004978 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:30.004527    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:30.004978 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:30.004632    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:30.004978 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:30.004678    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:30.004978 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:30.004764    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:30.004978 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:30.004823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:30.004978 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:30.004907    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:32.004281 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:32.004236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:32.004741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:32.004294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:32.004741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:32.004236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:32.004741 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:32.004393    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:32.004741 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:32.004453    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:32.004741 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:32.004515    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:34.004719 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:34.004690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:34.005149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:34.004787    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:34.005149 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:34.004796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:34.005149 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:34.004874    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:34.005149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:34.004883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:34.005149 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:34.004976    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:36.007507 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:36.007475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:36.007931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:36.007482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:36.007931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:36.007634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:36.007931 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.007625    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:36.007931 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.007732    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:36.007931 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.007815    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:36.684019 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:36.683974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:36.684019 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:36.684024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:36.684326 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.684146    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:36.684326 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.684151    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:36.684326 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.684211    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:13:52.684190225 +0000 UTC m=+33.158371820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:36.684326 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.684230    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:52.684221308 +0000 UTC m=+33.158402895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:36.785223 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:36.785180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:36.785466 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.785382    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:36.785466 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.785407    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:36.785466 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.785421    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:36.785651 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:36.785492    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:13:52.785470058 +0000 UTC m=+33.259651665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:38.004684 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:38.004648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:38.005185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:38.004673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:38.005185 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:38.004790    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:38.005185 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:38.004867    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:38.005185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:38.004904    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:38.005185 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:38.005008    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:40.004955 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:40.004920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:40.005451 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:40.005031    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:40.005451 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:40.005042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:40.005451 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:40.005192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:40.005451 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:40.005186    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:40.005451 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:40.005265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:42.004066 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:42.004026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:42.004554 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:42.004035    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:42.004554 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:42.004171    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:42.004554 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:42.004224    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:42.004554 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:42.004288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:42.004554 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:42.004348    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:43.245624 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.245189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal" event={"ID":"0e37f959504a10a7ebf5cd6917814e2e","Type":"ContainerStarted","Data":"39c740bc384794755cbd0754e031d6365160f1715e697d02ed333cf78460a540"}
Jul 03 15:13:43.247432 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.247405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h5wq2" event={"ID":"29831fb7-b939-4bf4-94c0-05738c0b9bc8","Type":"ContainerStarted","Data":"4e1b09c7c3865f44ce333aa63023105dfd88b6d53f516c5f23b641929706c50f"}
Jul 03 15:13:43.250835 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.250816    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:13:43.251187 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251162    2579 generic.go:356] "Generic (PLEG): container finished" podID="08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0" containerID="5dd03b0ae9d559ce6274e0f3f28cd4071c11f4fe9e939759b8ef4fbc500bc195" exitCode=1
Jul 03 15:13:43.251270 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"c33e5acc126b0fcbf10242d8a431c8a57f0959a634161de75ff7da7d936d3303"}
Jul 03 15:13:43.251330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"05a09d224cc6b153832f3b7fc8fa8a1d6f98039a62261caaa8bffdd9545a4a5c"}
Jul 03 15:13:43.251330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"4f3aefa87b2b0b99e2e800a72d774d78e78842f886135e6fef390904c0200bf2"}
Jul 03 15:13:43.251470 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"10d18fc89549de3434d04b7c71f2f4afa66c4052eb3f1e0a0b64ade40cd33e14"}
Jul 03 15:13:43.251470 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerDied","Data":"5dd03b0ae9d559ce6274e0f3f28cd4071c11f4fe9e939759b8ef4fbc500bc195"}
Jul 03 15:13:43.251567 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.251489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"42a195556e373617ee41c1f1fcc21b5f12c7f683e956838688f22e892d69a3eb"}
Jul 03 15:13:43.252683 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.252662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xllhm" event={"ID":"1c2f861c-a8a3-4fbe-82db-a799615d3f9c","Type":"ContainerStarted","Data":"6e2be05b7df5d6c912fa9c0d14392f5df92eddf9e534f9cf5b4ae2b3e3ba22c5"}
Jul 03 15:13:43.259784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.259745    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-243.ec2.internal" podStartSLOduration=22.259733169 podStartE2EDuration="22.259733169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:43.259517431 +0000 UTC m=+23.733699036" watchObservedRunningTime="2026-07-03 15:13:43.259733169 +0000 UTC m=+23.733914773"
Jul 03 15:13:43.280545 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.280511    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xllhm" podStartSLOduration=2.343926189 podStartE2EDuration="23.280498827s" totalImagesPullingTime="20.936572638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:43.280481502 +0000 UTC m=+23.754663107" watchObservedRunningTime="2026-07-03 15:13:43.280498827 +0000 UTC m=+23.754680432"
Jul 03 15:13:43.296710 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:43.296665    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h5wq2" podStartSLOduration=2.42600325 podStartE2EDuration="23.29665079s" totalImagesPullingTime="20.87064754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:43.296140427 +0000 UTC m=+23.770322032" watchObservedRunningTime="2026-07-03 15:13:43.29665079 +0000 UTC m=+23.770832395"
Jul 03 15:13:44.004177 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.004050    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:44.004435 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.004178    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:44.004435 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:44.004182    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:44.004435 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:44.004300    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:44.004735 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.004714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:44.004903 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:44.004874    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:44.257169 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.257072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swtq4" event={"ID":"0261fda3-060d-41e8-8a08-ef2deea6ca5a","Type":"ContainerStarted","Data":"71448f745acaf3fb916de158b1ba61c25bb0eb9bee91f5f163bfab072ba2d815"}
Jul 03 15:13:44.258980 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.258946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bz4g4" event={"ID":"022d0d05-74fc-49bc-8687-223939b898d1","Type":"ContainerStarted","Data":"3afb59be3ea45594e9a293c5cafcf018521155e34c4338c718dc01073f0d98dd"}
Jul 03 15:13:44.261034 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.260704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nm97r" event={"ID":"a31732f9-d018-4dcb-9801-f08e5a7a0d7b","Type":"ContainerStarted","Data":"2e8d3983378c4e1cd110c856022db43eb1227d7a116e601cccb55bfd97fcc8e9"}
Jul 03 15:13:44.262546 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.262511    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c97aa9-ad65-41f0-9ddc-d2287826fabd" containerID="9a70494a831ca769e70ca472fb4b03f9469dfba00a1f4e35067bcd4018793cf1" exitCode=0
Jul 03 15:13:44.262675 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.262610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerDied","Data":"9a70494a831ca769e70ca472fb4b03f9469dfba00a1f4e35067bcd4018793cf1"}
Jul 03 15:13:44.264408 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.264387    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff4e189349337a51c894b8e09bd7410c" containerID="f39745c91a84407112db1592b16ebf6ec6b2fb4923f1781a6e651f2c304f8fa6" exitCode=0
Jul 03 15:13:44.264509 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.264457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal" event={"ID":"ff4e189349337a51c894b8e09bd7410c","Type":"ContainerDied","Data":"f39745c91a84407112db1592b16ebf6ec6b2fb4923f1781a6e651f2c304f8fa6"}
Jul 03 15:13:44.267007 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.266816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mptlm" event={"ID":"980edf0e-cf08-4ffe-9bba-a2b46600c962","Type":"ContainerStarted","Data":"8727be18339d37dce4b4e6ce9dcca1230971a1f01c3601541a1fcb9e388ae888"}
Jul 03 15:13:44.268572 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.268545    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv" event={"ID":"8e3fd46e-e025-430b-98fe-4e6e75e5b89d","Type":"ContainerStarted","Data":"3c9e88b176aeb5075dca124ce2f9ece97c69c7f0225ddc636fc10dc4dde3be96"}
Jul 03 15:13:44.272953 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.272904    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swtq4" podStartSLOduration=3.336189486 podStartE2EDuration="24.272887054s" totalImagesPullingTime="20.936697568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:44.271880945 +0000 UTC m=+24.746062527" watchObservedRunningTime="2026-07-03 15:13:44.272887054 +0000 UTC m=+24.747068660"
Jul 03 15:13:44.303993 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.303945    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mptlm" podStartSLOduration=3.468385 podStartE2EDuration="24.303927559s" totalImagesPullingTime="20.835542559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:44.30355299 +0000 UTC m=+24.777734596" watchObservedRunningTime="2026-07-03 15:13:44.303927559 +0000 UTC m=+24.778109163"
Jul 03 15:13:44.343188 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.343132    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nm97r" podStartSLOduration=3.50201415 podStartE2EDuration="24.343111009s" totalImagesPullingTime="20.841096859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:44.343085961 +0000 UTC m=+24.817267567" watchObservedRunningTime="2026-07-03 15:13:44.343111009 +0000 UTC m=+24.817292619"
Jul 03 15:13:44.358931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.358885    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bz4g4" podStartSLOduration=3.534560229 podStartE2EDuration="24.358869388s" totalImagesPullingTime="20.824309159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:44.35849053 +0000 UTC m=+24.832672136" watchObservedRunningTime="2026-07-03 15:13:44.358869388 +0000 UTC m=+24.833050993"
Jul 03 15:13:44.561678 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.561597    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:44.562190 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.562173    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:44.710334 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.710315    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 03 15:13:44.907758 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.907679    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T15:13:44.710330664Z","UUID":"1689bc48-5cf4-4622-ae8d-5f217dab0507","Handler":null,"Name":"","Endpoint":""}
Jul 03 15:13:44.909145 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.909124    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 03 15:13:44.909279 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:44.909166    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 03 15:13:45.277537 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.277224    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv" event={"ID":"8e3fd46e-e025-430b-98fe-4e6e75e5b89d","Type":"ContainerStarted","Data":"8d23367869eae844ad822e5e3f80df8895d5542c727def0e40c18aeb1fe148c9"}
Jul 03 15:13:45.280973 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.280949    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:13:45.281418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.281392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"ab33557f09323eafe1809a3bc421ce9b0a6f62425960490ff015ceebfe384b2c"}
Jul 03 15:13:45.283712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.283428    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal" event={"ID":"ff4e189349337a51c894b8e09bd7410c","Type":"ContainerStarted","Data":"8d85872d2e9a7071a66fc01836d0660f2742b7dcddbbee293b11659d895947af"}
Jul 03 15:13:45.284306 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.284244    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:45.284425 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.284410    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swtq4"
Jul 03 15:13:45.302026 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:45.301976    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-243.ec2.internal" podStartSLOduration=24.301963493 podStartE2EDuration="24.301963493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:45.30154128 +0000 UTC m=+25.775722889" watchObservedRunningTime="2026-07-03 15:13:45.301963493 +0000 UTC m=+25.776145098"
Jul 03 15:13:46.004248 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:46.004161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:46.004248 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:46.004187    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:46.004509 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:46.004303    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:46.004509 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:46.004338    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:46.004601 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:46.004507    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:46.004601 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:46.004576    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:46.288145 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:46.288065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv" event={"ID":"8e3fd46e-e025-430b-98fe-4e6e75e5b89d","Type":"ContainerStarted","Data":"a9737b2ca7a00139e8a4edcad9b12afd07da732e6eac7991e33e1f4ec8431e09"}
Jul 03 15:13:46.306962 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:46.306903    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8c4rv" podStartSLOduration=3.293046017 podStartE2EDuration="26.30688068s" totalImagesPullingTime="23.013834663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:46.306447712 +0000 UTC m=+26.780629316" watchObservedRunningTime="2026-07-03 15:13:46.30688068 +0000 UTC m=+26.781062286"
Jul 03 15:13:48.004409 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.004181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:48.005049 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.004215    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:48.005049 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:48.004521    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:48.005049 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.004225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:48.005049 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:48.004604    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:48.005049 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:48.004703    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:48.295762 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.295731    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:13:48.296135 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.296109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"d41793f512123a91ec7c698ade62469e6f8764246769884eb4009ee60d9c90f4"}
Jul 03 15:13:48.296417 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.296389    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:48.296529 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.296473    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:48.296599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.296581    2579 scope.go:117] "RemoveContainer" containerID="5dd03b0ae9d559ce6274e0f3f28cd4071c11f4fe9e939759b8ef4fbc500bc195"
Jul 03 15:13:48.314305 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:48.314285    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:49.291773 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.291726    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-df46w"]
Jul 03 15:13:49.292485 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.291874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:49.292485 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:49.291980    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:49.292671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.292501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfqtr"]
Jul 03 15:13:49.292671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.292595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:49.292757 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:49.292690    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:49.293638 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.293609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rf68h"]
Jul 03 15:13:49.293744 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.293729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:49.293851 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:49.293831    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:49.302995 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.302971    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:13:49.303377 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.303339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" event={"ID":"08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0","Type":"ContainerStarted","Data":"841b51d219beaa0d877217f6ecdb6f147db78825e89bcaaf3064075407782ccb"}
Jul 03 15:13:49.303653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.303635    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:49.321290 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.321229    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:13:49.334117 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:49.334073    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t" podStartSLOduration=8.357860117 podStartE2EDuration="29.334057474s" totalImagesPullingTime="20.976197357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:13:49.333775008 +0000 UTC m=+29.807956615" watchObservedRunningTime="2026-07-03 15:13:49.334057474 +0000 UTC m=+29.808239102"
Jul 03 15:13:51.004577 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:51.004385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:51.004945 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:51.004432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:51.004945 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:51.004654    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:51.004945 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:51.004434    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:51.004945 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:51.004718    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:51.004945 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:51.004819    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:51.820521 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:51.820496    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nm97r_a31732f9-d018-4dcb-9801-f08e5a7a0d7b/dns-node-resolver/0.log"
Jul 03 15:13:52.312811 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:52.312779    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c97aa9-ad65-41f0-9ddc-d2287826fabd" containerID="3beea6ccea6e2a7604a9014edb51ef08f49ee9ec3525862f71df65bb92cd5b41" exitCode=0
Jul 03 15:13:52.313341 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:52.312843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerDied","Data":"3beea6ccea6e2a7604a9014edb51ef08f49ee9ec3525862f71df65bb92cd5b41"}
Jul 03 15:13:52.696078 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:52.696040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:52.696247 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:52.696095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:52.696247 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.696204    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:52.696329 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.696203    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:52.696388 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.696263    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret podName:9b2cb4f8-3226-40f7-9e55-b4964c8aba30 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:24.69624862 +0000 UTC m=+65.170430203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret") pod "global-pull-secret-syncer-kfqtr" (UID: "9b2cb4f8-3226-40f7-9e55-b4964c8aba30") : object "kube-system"/"original-pull-secret" not registered
Jul 03 15:13:52.696456 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.696406    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs podName:d1ce76a1-680f-4770-8e68-5b152eda3ccb nodeName:}" failed. No retries permitted until 2026-07-03 15:14:24.696383829 +0000 UTC m=+65.170565426 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs") pod "network-metrics-daemon-rf68h" (UID: "d1ce76a1-680f-4770-8e68-5b152eda3ccb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 15:13:52.797292 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:52.797259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:52.797482 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.797460    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 15:13:52.797482 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.797483    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 15:13:52.797561 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.797493    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rfv9m for pod openshift-network-diagnostics/network-check-target-df46w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:52.797561 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:52.797546    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m podName:aa3456cd-4c64-4719-8dac-349a0d86c7f9 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:24.79753226 +0000 UTC m=+65.271713846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rfv9m" (UniqueName: "kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m") pod "network-check-target-df46w" (UID: "aa3456cd-4c64-4719-8dac-349a0d86c7f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 15:13:52.798454 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:52.798428    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bz4g4_022d0d05-74fc-49bc-8687-223939b898d1/node-ca/0.log"
Jul 03 15:13:53.004056 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:53.003975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:53.004056 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:53.004016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:53.004267 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:53.004088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:53.004267 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:53.004106    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:53.004267 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:53.004161    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:53.004267 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:53.004234    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:53.317309 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:53.317224    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c97aa9-ad65-41f0-9ddc-d2287826fabd" containerID="0ae4841f92f435e5048ba21b06833de465d4ccaad5471a329bb01481540b24e2" exitCode=0
Jul 03 15:13:53.317309 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:53.317260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerDied","Data":"0ae4841f92f435e5048ba21b06833de465d4ccaad5471a329bb01481540b24e2"}
Jul 03 15:13:54.321598 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:54.321564    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c97aa9-ad65-41f0-9ddc-d2287826fabd" containerID="e1532d6a4adf22383bbd9329deabc342f9ff24b360615b761c2ae3eb2c5fd369" exitCode=0
Jul 03 15:13:54.321976 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:54.321613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerDied","Data":"e1532d6a4adf22383bbd9329deabc342f9ff24b360615b761c2ae3eb2c5fd369"}
Jul 03 15:13:55.003854 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:55.003816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:55.004052 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:55.003815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:55.004052 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:55.003956    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:55.004052 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:55.003816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:55.004223 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:55.003991    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:55.004223 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:55.004075    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:57.004338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:57.004131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:57.004838 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:57.004161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:57.004838 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:57.004440    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:57.004838 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:57.004211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:57.004838 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:57.004530    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:57.004838 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:57.004632    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:59.004767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:59.004732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:13:59.004767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:59.004764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:13:59.005204 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:59.004860    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:13:59.005204 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:59.004912    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:13:59.005204 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:59.005002    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:13:59.005204 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:13:59.005117    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:13:59.340921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:59.340882    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c97aa9-ad65-41f0-9ddc-d2287826fabd" containerID="f259a503f4af46112aa8d846cfc138dfe4f28a652afb9800ca3b8eacdf13fd22" exitCode=0
Jul 03 15:13:59.341080 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:13:59.340958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerDied","Data":"f259a503f4af46112aa8d846cfc138dfe4f28a652afb9800ca3b8eacdf13fd22"}
Jul 03 15:14:00.346152 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:00.346116    2579 generic.go:356] "Generic (PLEG): container finished" podID="a6c97aa9-ad65-41f0-9ddc-d2287826fabd" containerID="f3dd3212bd443150fc89d0163de661794f013b71333259da0455c3a9f08abe54" exitCode=0
Jul 03 15:14:00.346545 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:00.346173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerDied","Data":"f3dd3212bd443150fc89d0163de661794f013b71333259da0455c3a9f08abe54"}
Jul 03 15:14:01.004749 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:01.004708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:01.004749 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:01.004743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:01.005022 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:01.004708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:01.005022 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:01.004837    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:01.005022 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:01.004901    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:01.005022 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:01.004944    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:01.352165 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:01.352120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" event={"ID":"a6c97aa9-ad65-41f0-9ddc-d2287826fabd","Type":"ContainerStarted","Data":"7da40e4375aa0635ee814d900d4e4a922f8170cba91086b735afdeaac67af445"}
Jul 03 15:14:01.377063 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:01.377008    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wpmcz" podStartSLOduration=15.38739461 podStartE2EDuration="41.376994537s" totalImagesPullingTime="25.989599927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:01.376404011 +0000 UTC m=+41.850585617" watchObservedRunningTime="2026-07-03 15:14:01.376994537 +0000 UTC m=+41.851176142"
Jul 03 15:14:03.003963 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:03.003929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:03.004390 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:03.004026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:03.004390 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:03.004035    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:03.004390 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:03.004025    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:03.004390 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:03.004122    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:03.004390 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:03.004179    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:05.003744 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:05.003709    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:05.003744 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:05.003741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:05.004162 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:05.003751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:05.004162 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:05.003826    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:05.004162 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:05.004003    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:05.004162 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:05.004104    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:07.004340 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:07.004299    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:07.004340 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:07.004324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:07.004774 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:07.004442    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:07.004774 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:07.004456    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:07.004774 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:07.004507    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:07.004774 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:07.004581    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:09.004176 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:09.004142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:09.004176 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:09.004166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:09.004697 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:09.004142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:09.004697 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:09.004233    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:09.004697 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:09.004332    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:09.004697 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:09.004432    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:11.003768 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:11.003726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:11.003768 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:11.003771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:11.004225 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:11.003845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:11.004225 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:11.003863    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:11.004225 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:11.003928    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:11.004225 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:11.004010    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:13.003986 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.003956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:13.004405 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.003957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:13.004405 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.004094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:13.004405 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:13.004097    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqtr" podUID="9b2cb4f8-3226-40f7-9e55-b4964c8aba30"
Jul 03 15:14:13.004405 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:13.004181    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf68h" podUID="d1ce76a1-680f-4770-8e68-5b152eda3ccb"
Jul 03 15:14:13.004405 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:13.004276    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df46w" podUID="aa3456cd-4c64-4719-8dac-349a0d86c7f9"
Jul 03 15:14:13.362883 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.362854    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-243.ec2.internal" event="NodeReady"
Jul 03 15:14:13.363066 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.362996    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 03 15:14:13.418280 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.418244    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mcdr2"]
Jul 03 15:14:13.432148 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.432115    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rfl28"]
Jul 03 15:14:13.432323 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.432252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.435124 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.435096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 03 15:14:13.435258 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.435223    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2xkrx\""
Jul 03 15:14:13.435328 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.435229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 03 15:14:13.435767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.435344    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 03 15:14:13.438795 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.435889    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 03 15:14:13.446162 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.446139    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcdr2"]
Jul 03 15:14:13.446255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.446183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rfl28"]
Jul 03 15:14:13.446418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.446253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.449165 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.449139    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 03 15:14:13.449265 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.449197    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dft5m\""
Jul 03 15:14:13.449327 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.449300    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 03 15:14:13.449327 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.449155    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 03 15:14:13.521513 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.521479    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qnc5c"]
Jul 03 15:14:13.536382 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.536334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.537555 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.537532    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qnc5c"]
Jul 03 15:14:13.539342 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.539315    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 03 15:14:13.539489 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.539349    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w99m5\""
Jul 03 15:14:13.539489 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.539379    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 03 15:14:13.551014 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.550995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac626881-f507-4b2c-8c89-578f06e48c78-cert\") pod \"ingress-canary-rfl28\" (UID: \"ac626881-f507-4b2c-8c89-578f06e48c78\") " pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.551116 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.551021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psf5s\" (UniqueName: \"kubernetes.io/projected/ac626881-f507-4b2c-8c89-578f06e48c78-kube-api-access-psf5s\") pod \"ingress-canary-rfl28\" (UID: \"ac626881-f507-4b2c-8c89-578f06e48c78\") " pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.551116 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.551043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6500bce-2605-41e2-a674-17a776e1b65c-data-volume\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.551206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.551132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6500bce-2605-41e2-a674-17a776e1b65c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.551206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.551149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6500bce-2605-41e2-a674-17a776e1b65c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.551206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.551168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6500bce-2605-41e2-a674-17a776e1b65c-crio-socket\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.551206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.551182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgkwm\" (UniqueName: \"kubernetes.io/projected/e6500bce-2605-41e2-a674-17a776e1b65c-kube-api-access-jgkwm\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652583 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6500bce-2605-41e2-a674-17a776e1b65c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652583 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6500bce-2605-41e2-a674-17a776e1b65c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652583 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6500bce-2605-41e2-a674-17a776e1b65c-crio-socket\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652583 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgkwm\" (UniqueName: \"kubernetes.io/projected/e6500bce-2605-41e2-a674-17a776e1b65c-kube-api-access-jgkwm\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4kj9\" (UniqueName: \"kubernetes.io/projected/fa622d7d-633d-4ca8-8e08-caa95cf3511f-kube-api-access-q4kj9\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac626881-f507-4b2c-8c89-578f06e48c78-cert\") pod \"ingress-canary-rfl28\" (UID: \"ac626881-f507-4b2c-8c89-578f06e48c78\") " pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psf5s\" (UniqueName: \"kubernetes.io/projected/ac626881-f507-4b2c-8c89-578f06e48c78-kube-api-access-psf5s\") pod \"ingress-canary-rfl28\" (UID: \"ac626881-f507-4b2c-8c89-578f06e48c78\") " pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6500bce-2605-41e2-a674-17a776e1b65c-data-volume\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652780    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6500bce-2605-41e2-a674-17a776e1b65c-crio-socket\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa622d7d-633d-4ca8-8e08-caa95cf3511f-config-volume\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa622d7d-633d-4ca8-8e08-caa95cf3511f-tmp-dir\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.652895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.652898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa622d7d-633d-4ca8-8e08-caa95cf3511f-metrics-tls\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.653261 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.653040    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6500bce-2605-41e2-a674-17a776e1b65c-data-volume\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.653261 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.653159    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6500bce-2605-41e2-a674-17a776e1b65c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.656912 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.656879    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6500bce-2605-41e2-a674-17a776e1b65c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.657030 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.656929    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac626881-f507-4b2c-8c89-578f06e48c78-cert\") pod \"ingress-canary-rfl28\" (UID: \"ac626881-f507-4b2c-8c89-578f06e48c78\") " pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.660892 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.660867    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgkwm\" (UniqueName: \"kubernetes.io/projected/e6500bce-2605-41e2-a674-17a776e1b65c-kube-api-access-jgkwm\") pod \"insights-runtime-extractor-mcdr2\" (UID: \"e6500bce-2605-41e2-a674-17a776e1b65c\") " pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.661027 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.661012    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psf5s\" (UniqueName: \"kubernetes.io/projected/ac626881-f507-4b2c-8c89-578f06e48c78-kube-api-access-psf5s\") pod \"ingress-canary-rfl28\" (UID: \"ac626881-f507-4b2c-8c89-578f06e48c78\") " pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.743444 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.743408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcdr2"
Jul 03 15:14:13.753660 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.753632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kj9\" (UniqueName: \"kubernetes.io/projected/fa622d7d-633d-4ca8-8e08-caa95cf3511f-kube-api-access-q4kj9\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.753792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.753713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa622d7d-633d-4ca8-8e08-caa95cf3511f-config-volume\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.753792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.753731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa622d7d-633d-4ca8-8e08-caa95cf3511f-tmp-dir\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.753792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.753748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa622d7d-633d-4ca8-8e08-caa95cf3511f-metrics-tls\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.753936 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.753834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rfl28"
Jul 03 15:14:13.754055 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.754038    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa622d7d-633d-4ca8-8e08-caa95cf3511f-tmp-dir\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.754456 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.754432    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa622d7d-633d-4ca8-8e08-caa95cf3511f-config-volume\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.756242 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.756212    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa622d7d-633d-4ca8-8e08-caa95cf3511f-metrics-tls\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.761653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.761628    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4kj9\" (UniqueName: \"kubernetes.io/projected/fa622d7d-633d-4ca8-8e08-caa95cf3511f-kube-api-access-q4kj9\") pod \"dns-default-qnc5c\" (UID: \"fa622d7d-633d-4ca8-8e08-caa95cf3511f\") " pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.845176 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.845135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:13.946437 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.945847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcdr2"]
Jul 03 15:14:13.953649 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:13.953597    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6500bce_2605_41e2_a674_17a776e1b65c.slice/crio-fff51fa4bb52e1a6b3a9d1fd603348fbf6f0879a621f057bed01a47ce3cd1002 WatchSource:0}: Error finding container fff51fa4bb52e1a6b3a9d1fd603348fbf6f0879a621f057bed01a47ce3cd1002: Status 404 returned error can't find the container with id fff51fa4bb52e1a6b3a9d1fd603348fbf6f0879a621f057bed01a47ce3cd1002
Jul 03 15:14:13.967437 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:13.967411    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rfl28"]
Jul 03 15:14:13.970970 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:13.970943    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac626881_f507_4b2c_8c89_578f06e48c78.slice/crio-f2949cfcc2f322a004130bd97178ab5227ca38a469a269c2dd0054fdd00aa3d9 WatchSource:0}: Error finding container f2949cfcc2f322a004130bd97178ab5227ca38a469a269c2dd0054fdd00aa3d9: Status 404 returned error can't find the container with id f2949cfcc2f322a004130bd97178ab5227ca38a469a269c2dd0054fdd00aa3d9
Jul 03 15:14:14.031788 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:14.031760    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qnc5c"]
Jul 03 15:14:14.034802 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:14.034774    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa622d7d_633d_4ca8_8e08_caa95cf3511f.slice/crio-a745380199ac153b479780495401d03c106a5423b4aa7c4fdc9fac1c826f5b3e WatchSource:0}: Error finding container a745380199ac153b479780495401d03c106a5423b4aa7c4fdc9fac1c826f5b3e: Status 404 returned error can't find the container with id a745380199ac153b479780495401d03c106a5423b4aa7c4fdc9fac1c826f5b3e
Jul 03 15:14:14.383208 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:14.383174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcdr2" event={"ID":"e6500bce-2605-41e2-a674-17a776e1b65c","Type":"ContainerStarted","Data":"fff51fa4bb52e1a6b3a9d1fd603348fbf6f0879a621f057bed01a47ce3cd1002"}
Jul 03 15:14:14.384344 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:14.384318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnc5c" event={"ID":"fa622d7d-633d-4ca8-8e08-caa95cf3511f","Type":"ContainerStarted","Data":"a745380199ac153b479780495401d03c106a5423b4aa7c4fdc9fac1c826f5b3e"}
Jul 03 15:14:14.385444 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:14.385424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rfl28" event={"ID":"ac626881-f507-4b2c-8c89-578f06e48c78","Type":"ContainerStarted","Data":"f2949cfcc2f322a004130bd97178ab5227ca38a469a269c2dd0054fdd00aa3d9"}
Jul 03 15:14:15.004101 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.004061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:15.004586 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.004567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:15.005120 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.004986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:15.009808 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.009786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 15:14:15.009921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.009865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 15:14:15.009982 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.009923    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 15:14:15.009982 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.009865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf84\""
Jul 03 15:14:15.010238 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.010125    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 15:14:15.012537 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:15.012510    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cq8c8\""
Jul 03 15:14:17.734949 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.734918    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"]
Jul 03 15:14:17.737342 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.737314    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:17.740471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.740441    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fxlt8\""
Jul 03 15:14:17.740580 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.740553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 03 15:14:17.745714 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.745689    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"]
Jul 03 15:14:17.791145 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.791108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10c73981-e171-4596-b432-0c5f0c4cd8e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xmk8x\" (UID: \"10c73981-e171-4596-b432-0c5f0c4cd8e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:17.892136 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:17.892101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10c73981-e171-4596-b432-0c5f0c4cd8e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xmk8x\" (UID: \"10c73981-e171-4596-b432-0c5f0c4cd8e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:17.892313 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:17.892251    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 03 15:14:17.892379 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:17.892316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c73981-e171-4596-b432-0c5f0c4cd8e1-tls-certificates podName:10c73981-e171-4596-b432-0c5f0c4cd8e1 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:18.392300928 +0000 UTC m=+58.866482511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/10c73981-e171-4596-b432-0c5f0c4cd8e1-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-xmk8x" (UID: "10c73981-e171-4596-b432-0c5f0c4cd8e1") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 03 15:14:18.395592 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.395566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10c73981-e171-4596-b432-0c5f0c4cd8e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xmk8x\" (UID: \"10c73981-e171-4596-b432-0c5f0c4cd8e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:18.398068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.398038    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10c73981-e171-4596-b432-0c5f0c4cd8e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xmk8x\" (UID: \"10c73981-e171-4596-b432-0c5f0c4cd8e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:18.440758 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.440722    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-49wb5"]
Jul 03 15:14:18.443880 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.443857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:18.446578 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.446555    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 03 15:14:18.446711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.446613    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8prk8\""
Jul 03 15:14:18.446711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.446556    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 03 15:14:18.453547 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.453511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-49wb5"]
Jul 03 15:14:18.496487 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.496444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2zq2\" (UniqueName: \"kubernetes.io/projected/f900f538-ee9c-40b9-b807-6e4211a788d5-kube-api-access-s2zq2\") pod \"downloads-685bfb5f64-49wb5\" (UID: \"f900f538-ee9c-40b9-b807-6e4211a788d5\") " pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:18.597858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.597820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2zq2\" (UniqueName: \"kubernetes.io/projected/f900f538-ee9c-40b9-b807-6e4211a788d5-kube-api-access-s2zq2\") pod \"downloads-685bfb5f64-49wb5\" (UID: \"f900f538-ee9c-40b9-b807-6e4211a788d5\") " pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:18.606789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.606755    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2zq2\" (UniqueName: \"kubernetes.io/projected/f900f538-ee9c-40b9-b807-6e4211a788d5-kube-api-access-s2zq2\") pod \"downloads-685bfb5f64-49wb5\" (UID: \"f900f538-ee9c-40b9-b807-6e4211a788d5\") " pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:18.648312 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.648234    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:18.755803 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:18.755757    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:19.445910 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:19.445866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"]
Jul 03 15:14:19.459851 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:19.457734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-49wb5"]
Jul 03 15:14:20.418261 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.418214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rfl28" event={"ID":"ac626881-f507-4b2c-8c89-578f06e48c78","Type":"ContainerStarted","Data":"8346c03b9ebe9fbc613437515e00f5f3dcf146e4c85bfa56c54d5f8e751322e0"}
Jul 03 15:14:20.420481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.420444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcdr2" event={"ID":"e6500bce-2605-41e2-a674-17a776e1b65c","Type":"ContainerStarted","Data":"3179ac518260db94fce626788535ba9d39bbeaaa2d8bdc5ec7d6dc632263ffeb"}
Jul 03 15:14:20.420622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.420508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcdr2" event={"ID":"e6500bce-2605-41e2-a674-17a776e1b65c","Type":"ContainerStarted","Data":"debb4443fec66818af82435bda4feec85fe770748aca4f48729a97d5335649bc"}
Jul 03 15:14:20.421746 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.421704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-49wb5" event={"ID":"f900f538-ee9c-40b9-b807-6e4211a788d5","Type":"ContainerStarted","Data":"15278de994e1777fc52435f9204e26e62eb9484126d625046b7ffac5f5afce37"}
Jul 03 15:14:20.424519 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.424063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnc5c" event={"ID":"fa622d7d-633d-4ca8-8e08-caa95cf3511f","Type":"ContainerStarted","Data":"1402936e01f56c9a8070eaef9ac93152658c5a279efa15964a6cdbb1f32eb11a"}
Jul 03 15:14:20.424519 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.424113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnc5c" event={"ID":"fa622d7d-633d-4ca8-8e08-caa95cf3511f","Type":"ContainerStarted","Data":"c20b906a6c671dc6cf68d8a7c9583ee0bf1acbb03bed68ba7c605ff7ad639c2a"}
Jul 03 15:14:20.424519 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.424162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:20.425421 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.425392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x" event={"ID":"10c73981-e171-4596-b432-0c5f0c4cd8e1","Type":"ContainerStarted","Data":"324fea4cbd30c292a527255207b8f9e585a06e56f36a54c57a8d9cfee3fa66ed"}
Jul 03 15:14:20.435927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.435878    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rfl28" podStartSLOduration=2.120701559 podStartE2EDuration="7.435864834s" totalImagesPullingTime="5.315163275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:20.434135157 +0000 UTC m=+60.908316762" watchObservedRunningTime="2026-07-03 15:14:20.435864834 +0000 UTC m=+60.910046417"
Jul 03 15:14:20.456228 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:20.456038    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qnc5c" podStartSLOduration=2.225992702 podStartE2EDuration="7.456017245s" totalImagesPullingTime="5.230024543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:20.455283666 +0000 UTC m=+60.929465274" watchObservedRunningTime="2026-07-03 15:14:20.456017245 +0000 UTC m=+60.930198832"
Jul 03 15:14:21.323643 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.323598    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-glj6t"
Jul 03 15:14:21.437145 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.437106    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x" event={"ID":"10c73981-e171-4596-b432-0c5f0c4cd8e1","Type":"ContainerStarted","Data":"2a3600a737a7b3633981e7038a0e824f5a355e19a264e018be0d580328e3909a"}
Jul 03 15:14:21.437843 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.437818    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:21.443975 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.443943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x"
Jul 03 15:14:21.453230 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.453180    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xmk8x" podStartSLOduration=3.153350811 podStartE2EDuration="4.453160975s" totalImagesPullingTime="1.299810164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:21.451815817 +0000 UTC m=+61.925997423" watchObservedRunningTime="2026-07-03 15:14:21.453160975 +0000 UTC m=+61.927342584"
Jul 03 15:14:21.801451 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.800749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"]
Jul 03 15:14:21.817529 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.816534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"]
Jul 03 15:14:21.817529 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.816665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:21.819710 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.819691    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 03 15:14:21.819835 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.819754    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f59ng\""
Jul 03 15:14:21.820086 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.820065    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 03 15:14:21.820220 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.820073    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 03 15:14:21.820663 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.820645    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 03 15:14:21.821551 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.821528    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 03 15:14:21.921105 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.921061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99128881-126a-46d6-ac9e-8a681300e818-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:21.921288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.921119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqhqz\" (UniqueName: \"kubernetes.io/projected/99128881-126a-46d6-ac9e-8a681300e818-kube-api-access-bqhqz\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:21.921288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.921264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:21.921399 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:21.921311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.022137 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.022098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99128881-126a-46d6-ac9e-8a681300e818-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.022316 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.022181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqhqz\" (UniqueName: \"kubernetes.io/projected/99128881-126a-46d6-ac9e-8a681300e818-kube-api-access-bqhqz\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.022316 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.022258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.022316 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.022288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.022925 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.022890    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99128881-126a-46d6-ac9e-8a681300e818-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.023031 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:22.023010    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 03 15:14:22.023091 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:22.023067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-tls podName:99128881-126a-46d6-ac9e-8a681300e818 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:22.523049911 +0000 UTC m=+62.997231497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-4fmdz" (UID: "99128881-126a-46d6-ac9e-8a681300e818") : secret "prometheus-operator-tls" not found
Jul 03 15:14:22.025980 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.025956    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.032209 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.032180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqhqz\" (UniqueName: \"kubernetes.io/projected/99128881-126a-46d6-ac9e-8a681300e818-kube-api-access-bqhqz\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.526961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.526918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.529967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.529934    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/99128881-126a-46d6-ac9e-8a681300e818-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4fmdz\" (UID: \"99128881-126a-46d6-ac9e-8a681300e818\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:22.729243 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:22.729189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"
Jul 03 15:14:23.344476 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:23.344441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz"]
Jul 03 15:14:23.347711 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:23.347681    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99128881_126a_46d6_ac9e_8a681300e818.slice/crio-531e9e9b361f740b91cb136bc12965deccb80fb4858c4d1eddf6e25adc99f1ba WatchSource:0}: Error finding container 531e9e9b361f740b91cb136bc12965deccb80fb4858c4d1eddf6e25adc99f1ba: Status 404 returned error can't find the container with id 531e9e9b361f740b91cb136bc12965deccb80fb4858c4d1eddf6e25adc99f1ba
Jul 03 15:14:23.446932 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:23.446896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcdr2" event={"ID":"e6500bce-2605-41e2-a674-17a776e1b65c","Type":"ContainerStarted","Data":"e7d729ff2ce0cd0af268f07c4f9437b9b27443065fb8ba5f9a1e2f8ca55a7a2a"}
Jul 03 15:14:23.448449 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:23.448408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz" event={"ID":"99128881-126a-46d6-ac9e-8a681300e818","Type":"ContainerStarted","Data":"531e9e9b361f740b91cb136bc12965deccb80fb4858c4d1eddf6e25adc99f1ba"}
Jul 03 15:14:23.466080 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:23.465990    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mcdr2" podStartSLOduration=1.368266505 podStartE2EDuration="10.465969634s" totalImagesPullingTime="9.097703129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:14:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:23.465024763 +0000 UTC m=+63.939206370" watchObservedRunningTime="2026-07-03 15:14:23.465969634 +0000 UTC m=+63.940151238"
Jul 03 15:14:24.746815 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.746777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:24.747255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.746829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:24.749917 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.749888    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 15:14:24.750041 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.749952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 15:14:24.759928 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.759896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b2cb4f8-3226-40f7-9e55-b4964c8aba30-original-pull-secret\") pod \"global-pull-secret-syncer-kfqtr\" (UID: \"9b2cb4f8-3226-40f7-9e55-b4964c8aba30\") " pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:24.759928 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.759918    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1ce76a1-680f-4770-8e68-5b152eda3ccb-metrics-certs\") pod \"network-metrics-daemon-rf68h\" (UID: \"d1ce76a1-680f-4770-8e68-5b152eda3ccb\") " pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:24.847758 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.847721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:24.850848 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.850821    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 15:14:24.860915 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.860894    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 15:14:24.872451 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.872426    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfv9m\" (UniqueName: \"kubernetes.io/projected/aa3456cd-4c64-4719-8dac-349a0d86c7f9-kube-api-access-rfv9m\") pod \"network-check-target-df46w\" (UID: \"aa3456cd-4c64-4719-8dac-349a0d86c7f9\") " pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:24.921096 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.921073    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cq8c8\""
Jul 03 15:14:24.929351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.929331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf68h"
Jul 03 15:14:24.931605 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.931580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqtr"
Jul 03 15:14:24.942164 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.942142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf84\""
Jul 03 15:14:24.950427 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:24.950396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:25.111888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.111798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rf68h"]
Jul 03 15:14:25.115487 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:25.115432    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ce76a1_680f_4770_8e68_5b152eda3ccb.slice/crio-8754c68380784f979c58f76fb6a9cc9bd98d0312753194ba7fcaf87d9f749767 WatchSource:0}: Error finding container 8754c68380784f979c58f76fb6a9cc9bd98d0312753194ba7fcaf87d9f749767: Status 404 returned error can't find the container with id 8754c68380784f979c58f76fb6a9cc9bd98d0312753194ba7fcaf87d9f749767
Jul 03 15:14:25.337274 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.337195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-df46w"]
Jul 03 15:14:25.339889 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.339866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfqtr"]
Jul 03 15:14:25.340498 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:25.340469    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3456cd_4c64_4719_8dac_349a0d86c7f9.slice/crio-579ede54644725869554c7d22a4985910e6f17ec82965e272855737002acef70 WatchSource:0}: Error finding container 579ede54644725869554c7d22a4985910e6f17ec82965e272855737002acef70: Status 404 returned error can't find the container with id 579ede54644725869554c7d22a4985910e6f17ec82965e272855737002acef70
Jul 03 15:14:25.343499 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:25.343475    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2cb4f8_3226_40f7_9e55_b4964c8aba30.slice/crio-fec34ac10126b851c3f8a8a18a791c8a70db0501e9a0b1237f86ecc0b0b0dd04 WatchSource:0}: Error finding container fec34ac10126b851c3f8a8a18a791c8a70db0501e9a0b1237f86ecc0b0b0dd04: Status 404 returned error can't find the container with id fec34ac10126b851c3f8a8a18a791c8a70db0501e9a0b1237f86ecc0b0b0dd04
Jul 03 15:14:25.462755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.462718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz" event={"ID":"99128881-126a-46d6-ac9e-8a681300e818","Type":"ContainerStarted","Data":"6d9dd1b8dfcc32832124d2d76d6ce0629c193305f46ed08cc573a9de2586182a"}
Jul 03 15:14:25.462942 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.462821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz" event={"ID":"99128881-126a-46d6-ac9e-8a681300e818","Type":"ContainerStarted","Data":"feb83d81a7547a695592744109a2b07eee72d1d2c35b57e26de6c413c717ecae"}
Jul 03 15:14:25.464516 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.464484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-df46w" event={"ID":"aa3456cd-4c64-4719-8dac-349a0d86c7f9","Type":"ContainerStarted","Data":"579ede54644725869554c7d22a4985910e6f17ec82965e272855737002acef70"}
Jul 03 15:14:25.465745 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.465723    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfqtr" event={"ID":"9b2cb4f8-3226-40f7-9e55-b4964c8aba30","Type":"ContainerStarted","Data":"fec34ac10126b851c3f8a8a18a791c8a70db0501e9a0b1237f86ecc0b0b0dd04"}
Jul 03 15:14:25.467277 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.467253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rf68h" event={"ID":"d1ce76a1-680f-4770-8e68-5b152eda3ccb","Type":"ContainerStarted","Data":"8754c68380784f979c58f76fb6a9cc9bd98d0312753194ba7fcaf87d9f749767"}
Jul 03 15:14:25.480104 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:25.480056    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4fmdz" podStartSLOduration=2.919237191 podStartE2EDuration="4.480042914s" totalImagesPullingTime="1.560805723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:25.478740725 +0000 UTC m=+65.952922350" watchObservedRunningTime="2026-07-03 15:14:25.480042914 +0000 UTC m=+65.954224519"
Jul 03 15:14:26.475523 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:26.474909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rf68h" event={"ID":"d1ce76a1-680f-4770-8e68-5b152eda3ccb","Type":"ContainerStarted","Data":"143da9d4ad48b3a0879eb7eda7d42138a8270715d336001d6528f1e9ec1cf12d"}
Jul 03 15:14:26.475523 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:26.474977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rf68h" event={"ID":"d1ce76a1-680f-4770-8e68-5b152eda3ccb","Type":"ContainerStarted","Data":"baa8d629c18653041deee1c4fa7d294e61a67d6cb6a93e42a423657aaf047073"}
Jul 03 15:14:26.493021 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:26.492953    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rf68h" podStartSLOduration=65.485214716 podStartE2EDuration="1m6.492930981s" totalImagesPullingTime="1.007716265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:26.491023222 +0000 UTC m=+66.965204844" watchObservedRunningTime="2026-07-03 15:14:26.492930981 +0000 UTC m=+66.967112587"
Jul 03 15:14:27.162640 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.161577    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"]
Jul 03 15:14:27.164940 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.164913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.168110 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.168082    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 03 15:14:27.168244 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.168192    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 03 15:14:27.168515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.168498    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dnmvk\""
Jul 03 15:14:27.177634 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.177609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"]
Jul 03 15:14:27.200888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.200848    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"]
Jul 03 15:14:27.204329 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.204301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.205036 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.204502    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bn4h5"]
Jul 03 15:14:27.207407 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.207193    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9rm2w\""
Jul 03 15:14:27.207663 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.207631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.208988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.208808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 03 15:14:27.213331 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.213292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 03 15:14:27.213530 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.213511    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 03 15:14:27.213728 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.213706    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 03 15:14:27.213988 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.213971    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 03 15:14:27.217741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.214169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c2mmx\""
Jul 03 15:14:27.217741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.214416    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 03 15:14:27.222643 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.222620    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"]
Jul 03 15:14:27.265835 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.266003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmt6z\" (UniqueName: \"kubernetes.io/projected/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-kube-api-access-bmt6z\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.266003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-wtmp\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.266003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdcc2\" (UniqueName: \"kubernetes.io/projected/b96d80b8-a722-41aa-a7fb-2460b7e029df-kube-api-access-cdcc2\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.266003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.265993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b96d80b8-a722-41aa-a7fb-2460b7e029df-metrics-client-ca\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-root\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-sys\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-textfile\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e3fc7c24-2100-43fe-9dd1-858d0947a80a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zng29\" (UniqueName: \"kubernetes.io/projected/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-api-access-zng29\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.266272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-accelerators-collector-config\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.267043 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-tls\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.267043 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.267043 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.266385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3fc7c24-2100-43fe-9dd1-858d0947a80a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.366790 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.366965 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e3fc7c24-2100-43fe-9dd1-858d0947a80a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.366965 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zng29\" (UniqueName: \"kubernetes.io/projected/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-api-access-zng29\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.366965 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.366965 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-accelerators-collector-config\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367129 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-tls\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367129 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.366993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.367129 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3fc7c24-2100-43fe-9dd1-858d0947a80a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.367129 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.367129 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt6z\" (UniqueName: \"kubernetes.io/projected/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-kube-api-access-bmt6z\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.367129 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-wtmp\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdcc2\" (UniqueName: \"kubernetes.io/projected/b96d80b8-a722-41aa-a7fb-2460b7e029df-kube-api-access-cdcc2\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b96d80b8-a722-41aa-a7fb-2460b7e029df-metrics-client-ca\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-root\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-sys\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367322    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e3fc7c24-2100-43fe-9dd1-858d0947a80a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.367416 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-textfile\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367734 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367640    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-root\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367734 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367698    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.367734 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367718    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-textfile\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.367884 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.367862    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-wtmp\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.368768 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:27.368036    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 03 15:14:27.368768 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:27.368109    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-tls podName:ec5bbd33-21ef-49a8-acd9-c0e1503b19a2 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:27.868087955 +0000 UTC m=+68.342269555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-2l9pf" (UID: "ec5bbd33-21ef-49a8-acd9-c0e1503b19a2") : secret "openshift-state-metrics-tls" not found
Jul 03 15:14:27.368768 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.368172    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b96d80b8-a722-41aa-a7fb-2460b7e029df-metrics-client-ca\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.368768 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.368335    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b96d80b8-a722-41aa-a7fb-2460b7e029df-sys\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.369055 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.368775    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3fc7c24-2100-43fe-9dd1-858d0947a80a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.369055 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.368800    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.369055 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.368968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-accelerators-collector-config\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.372917 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.372872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-tls\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.373347 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.373253    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.374258 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.374229    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.374503 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.374470    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.375411 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.375353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b96d80b8-a722-41aa-a7fb-2460b7e029df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.384712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.384622    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zng29\" (UniqueName: \"kubernetes.io/projected/e3fc7c24-2100-43fe-9dd1-858d0947a80a-kube-api-access-zng29\") pod \"kube-state-metrics-7c9dbb8b7d-b2hzc\" (UID: \"e3fc7c24-2100-43fe-9dd1-858d0947a80a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.385506 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.385484    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdcc2\" (UniqueName: \"kubernetes.io/projected/b96d80b8-a722-41aa-a7fb-2460b7e029df-kube-api-access-cdcc2\") pod \"node-exporter-bn4h5\" (UID: \"b96d80b8-a722-41aa-a7fb-2460b7e029df\") " pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.387887 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.387860    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmt6z\" (UniqueName: \"kubernetes.io/projected/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-kube-api-access-bmt6z\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.520041 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.519938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"
Jul 03 15:14:27.527949 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.527573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bn4h5"
Jul 03 15:14:27.541948 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:27.541917    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96d80b8_a722_41aa_a7fb_2460b7e029df.slice/crio-56ba78ef3a5206e00d8660d58e92eb97e7d744b2117add8f3cd68939daa831ff WatchSource:0}: Error finding container 56ba78ef3a5206e00d8660d58e92eb97e7d744b2117add8f3cd68939daa831ff: Status 404 returned error can't find the container with id 56ba78ef3a5206e00d8660d58e92eb97e7d744b2117add8f3cd68939daa831ff
Jul 03 15:14:27.707163 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.707132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc"]
Jul 03 15:14:27.711854 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:27.711807    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fc7c24_2100_43fe_9dd1_858d0947a80a.slice/crio-8fd520dc0a949a61858ddc126ee60a4c8e35f3e13b733f04fb7c28c249862efe WatchSource:0}: Error finding container 8fd520dc0a949a61858ddc126ee60a4c8e35f3e13b733f04fb7c28c249862efe: Status 404 returned error can't find the container with id 8fd520dc0a949a61858ddc126ee60a4c8e35f3e13b733f04fb7c28c249862efe
Jul 03 15:14:27.870827 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.870787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:27.873889 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:27.873861    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5bbd33-21ef-49a8-acd9-c0e1503b19a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-2l9pf\" (UID: \"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:28.077110 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.077018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"
Jul 03 15:14:28.242830 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.242794    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:14:28.251611 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.251525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.258415 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.258388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rvk7h\""
Jul 03 15:14:28.258572 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.258499    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 03 15:14:28.258756 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.258730    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 03 15:14:28.258854 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.258831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 03 15:14:28.258854 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.258837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 03 15:14:28.259031 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.259013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 03 15:14:28.259031 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.259025    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 03 15:14:28.259143 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.259034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 03 15:14:28.259143 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.259089    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 03 15:14:28.259143 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.259039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 03 15:14:28.268670 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.268649    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:14:28.270828 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.270803    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf"]
Jul 03 15:14:28.273638 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273745 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273745 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273862 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273862 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273862 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jczht\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-kube-api-access-jczht\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273862 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-web-config\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.273862 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.274091 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-out\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.274091 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.274091 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.274091 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.273964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.274091 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.274015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.275639 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:28.275618    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5bbd33_21ef_49a8_acd9_c0e1503b19a2.slice/crio-fca6467d34530e468c1d235d4e8bbacb7037ba3e4044affcf0f275917a0fec48 WatchSource:0}: Error finding container fca6467d34530e468c1d235d4e8bbacb7037ba3e4044affcf0f275917a0fec48: Status 404 returned error can't find the container with id fca6467d34530e468c1d235d4e8bbacb7037ba3e4044affcf0f275917a0fec48
Jul 03 15:14:28.367911 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.367880    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755886c6cd-9f9gm"]
Jul 03 15:14:28.375887 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.375851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.375891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.375927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.375952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jczht\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-kube-api-access-jczht\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-web-config\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376390 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376390 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-out\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376390 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376390 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.376704 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.376640    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.382517 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:28.380125    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 03 15:14:28.382517 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:28.380201    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls podName:bfccf5cf-925f-4d60-9000-291c23bed4b2 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:28.880180559 +0000 UTC m=+69.354362164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2") : secret "alertmanager-main-tls" not found
Jul 03 15:14:28.382517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.380393    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.383937 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.383904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.385312 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:28.384489    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle podName:bfccf5cf-925f-4d60-9000-291c23bed4b2 nodeName:}" failed. No retries permitted until 2026-07-03 15:14:28.884470802 +0000 UTC m=+69.358652406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2") : configmap references non-existent config key: ca-bundle.crt
Jul 03 15:14:28.385312 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.384909    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.389057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.388957    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.390826 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.390792    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-out\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.390895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.390858    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-web-config\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.392002 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.391850    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.392002 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.391909    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.394584 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.394561    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.399330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.398504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755886c6cd-9f9gm"]
Jul 03 15:14:28.399330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.398610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.404440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.402955    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 03 15:14:28.404440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.403205    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 03 15:14:28.404440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.403921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jzkqj\""
Jul 03 15:14:28.404440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.404024    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 03 15:14:28.404440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.404116    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 03 15:14:28.404440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.404317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 03 15:14:28.404889 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.404829    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jczht\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-kube-api-access-jczht\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.476940 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.476729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-service-ca\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.476940 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.476776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5fg\" (UniqueName: \"kubernetes.io/projected/fc34b155-a2d5-4559-bbcf-e608452e5d37-kube-api-access-gb5fg\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.478083 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.477788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-config\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.478083 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.477840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-oauth-serving-cert\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.478083 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.477879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-oauth-config\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.478083 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.477916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-serving-cert\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.487604 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.487528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc" event={"ID":"e3fc7c24-2100-43fe-9dd1-858d0947a80a","Type":"ContainerStarted","Data":"8fd520dc0a949a61858ddc126ee60a4c8e35f3e13b733f04fb7c28c249862efe"}
Jul 03 15:14:28.490101 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.490067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf" event={"ID":"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2","Type":"ContainerStarted","Data":"5f982417ad2e1557b11f92efd98da691fbbe6cd39955278dc45a58c733888038"}
Jul 03 15:14:28.490223 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.490135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf" event={"ID":"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2","Type":"ContainerStarted","Data":"fca6467d34530e468c1d235d4e8bbacb7037ba3e4044affcf0f275917a0fec48"}
Jul 03 15:14:28.491767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.491705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bn4h5" event={"ID":"b96d80b8-a722-41aa-a7fb-2460b7e029df","Type":"ContainerStarted","Data":"56ba78ef3a5206e00d8660d58e92eb97e7d744b2117add8f3cd68939daa831ff"}
Jul 03 15:14:28.580946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.579574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-serving-cert\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.580946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.579660    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-service-ca\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.580946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.579698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5fg\" (UniqueName: \"kubernetes.io/projected/fc34b155-a2d5-4559-bbcf-e608452e5d37-kube-api-access-gb5fg\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.580946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.579748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-config\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.580946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.579792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-oauth-serving-cert\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.580946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.579830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-oauth-config\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.582593 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.582506    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-config\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.583896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.583133    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-service-ca\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.583896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.583658    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-oauth-serving-cert\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.583896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.583855    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-oauth-config\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.588412 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.588340    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-serving-cert\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.590611 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.590569    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5fg\" (UniqueName: \"kubernetes.io/projected/fc34b155-a2d5-4559-bbcf-e608452e5d37-kube-api-access-gb5fg\") pod \"console-755886c6cd-9f9gm\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") " pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.733405 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.733296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:28.882275 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.882233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.885582 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.885558    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.983860 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.983774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:28.984748 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:28.984716    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:29.174249 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:29.174197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:14:29.499132 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:29.499092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf" event={"ID":"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2","Type":"ContainerStarted","Data":"f8c4802442fa4906088a9dde8930131373057cb7c23963894624f8159925112a"}
Jul 03 15:14:30.170562 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.170526    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"]
Jul 03 15:14:30.174205 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.174182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.177784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.177241    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hr26t\""
Jul 03 15:14:30.177784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.177300    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 03 15:14:30.177784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.177575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 03 15:14:30.177784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.177600    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 03 15:14:30.177784 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.177667    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 03 15:14:30.178121 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.177818    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 03 15:14:30.178654 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.178634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-baacblca41oc3\""
Jul 03 15:14:30.185049 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.185026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"]
Jul 03 15:14:30.194379 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adcc94ff-126d-49d7-83d0-0c0d8e147b70-metrics-client-ca\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194495 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwd2\" (UniqueName: \"kubernetes.io/projected/adcc94ff-126d-49d7-83d0-0c0d8e147b70-kube-api-access-8bwd2\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-grpc-tls\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.194737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.194723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-tls\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.295708 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.295663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adcc94ff-126d-49d7-83d0-0c0d8e147b70-metrics-client-ca\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.295888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.295771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.295888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.295846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.295888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.295882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwd2\" (UniqueName: \"kubernetes.io/projected/adcc94ff-126d-49d7-83d0-0c0d8e147b70-kube-api-access-8bwd2\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.296047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.295917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-grpc-tls\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.296047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.295973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.296047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.296001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.296183 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.296048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-tls\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.296639 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.296439    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adcc94ff-126d-49d7-83d0-0c0d8e147b70-metrics-client-ca\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.299202 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.299177    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.299643 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.299619    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.299738 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.299714    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.299858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.299833    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.299923 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.299896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-thanos-querier-tls\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.301999 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.301973    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adcc94ff-126d-49d7-83d0-0c0d8e147b70-secret-grpc-tls\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.306804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.306785    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwd2\" (UniqueName: \"kubernetes.io/projected/adcc94ff-126d-49d7-83d0-0c0d8e147b70-kube-api-access-8bwd2\") pod \"thanos-querier-5fd87bb5f8-t2dzg\" (UID: \"adcc94ff-126d-49d7-83d0-0c0d8e147b70\") " pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:30.439471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.439391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qnc5c"
Jul 03 15:14:30.488217 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:30.487937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:31.574912 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.574865    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-659c9f7c5-d88rr"]
Jul 03 15:14:31.578213 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.578191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.581586 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.581276    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 03 15:14:31.581586 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.581340    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 03 15:14:31.582804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.582719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 03 15:14:31.582804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.582731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 03 15:14:31.582804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.582762    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-v5tzd\""
Jul 03 15:14:31.582804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.582781    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-73tv41k3p7ses\""
Jul 03 15:14:31.589323 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.587935    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-659c9f7c5-d88rr"]
Jul 03 15:14:31.605607 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2htx4\" (UniqueName: \"kubernetes.io/projected/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-kube-api-access-2htx4\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.605755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-secret-metrics-server-client-certs\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.605755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.605755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-audit-log\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.605755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-metrics-server-audit-profiles\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.605961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-client-ca-bundle\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.605961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.605882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-secret-metrics-server-tls\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707146 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2htx4\" (UniqueName: \"kubernetes.io/projected/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-kube-api-access-2htx4\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707335 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-secret-metrics-server-client-certs\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707335 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707335 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-audit-log\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707335 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-metrics-server-audit-profiles\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707335 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-client-ca-bundle\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707637 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-secret-metrics-server-tls\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.707945 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.707896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-audit-log\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.708239 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.708218    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.708948 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.708925    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-metrics-server-audit-profiles\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.709917 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.709896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-secret-metrics-server-client-certs\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.710332 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.710315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-secret-metrics-server-tls\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.710431 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.710338    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-client-ca-bundle\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.715846 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.715806    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2htx4\" (UniqueName: \"kubernetes.io/projected/d02c3683-aa69-4f58-8ca7-4a0a7f965fac-kube-api-access-2htx4\") pod \"metrics-server-659c9f7c5-d88rr\" (UID: \"d02c3683-aa69-4f58-8ca7-4a0a7f965fac\") " pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.892795 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.892472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:31.930021 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.929978    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"]
Jul 03 15:14:31.934060 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.933530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:31.936421 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.936384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 03 15:14:31.936745 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.936544    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sqn4k\""
Jul 03 15:14:31.945016 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:31.944983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"]
Jul 03 15:14:32.010302 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.010267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk6q4\" (UniqueName: \"kubernetes.io/projected/80735b42-cbc2-48e7-93dc-42a0fc6d005f-kube-api-access-tk6q4\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.010510 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.010326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80735b42-cbc2-48e7-93dc-42a0fc6d005f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.111475 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.111290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6q4\" (UniqueName: \"kubernetes.io/projected/80735b42-cbc2-48e7-93dc-42a0fc6d005f-kube-api-access-tk6q4\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.111475 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.111385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80735b42-cbc2-48e7-93dc-42a0fc6d005f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.111662 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:32.111554    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 03 15:14:32.111662 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:14:32.111637    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80735b42-cbc2-48e7-93dc-42a0fc6d005f-monitoring-plugin-cert podName:80735b42-cbc2-48e7-93dc-42a0fc6d005f nodeName:}" failed. No retries permitted until 2026-07-03 15:14:32.611619552 +0000 UTC m=+73.085801134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/80735b42-cbc2-48e7-93dc-42a0fc6d005f-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-4tt8z" (UID: "80735b42-cbc2-48e7-93dc-42a0fc6d005f") : secret "monitoring-plugin-cert" not found
Jul 03 15:14:32.120875 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.120844    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk6q4\" (UniqueName: \"kubernetes.io/projected/80735b42-cbc2-48e7-93dc-42a0fc6d005f-kube-api-access-tk6q4\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.615645 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.615607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80735b42-cbc2-48e7-93dc-42a0fc6d005f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.618440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.618411    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80735b42-cbc2-48e7-93dc-42a0fc6d005f-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4tt8z\" (UID: \"80735b42-cbc2-48e7-93dc-42a0fc6d005f\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:32.846893 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:32.846857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:33.401298 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.401261    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:14:33.405879 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.405816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.410138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 03 15:14:33.410138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410096    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 03 15:14:33.410138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410121    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 03 15:14:33.410517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410145    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 03 15:14:33.410517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410166    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 03 15:14:33.410517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410285    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 03 15:14:33.410517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 03 15:14:33.410517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410314    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 03 15:14:33.410741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410607    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 03 15:14:33.410813 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410787    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eu9lovbvg4sos\""
Jul 03 15:14:33.410929 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.410848    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 03 15:14:33.411731 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.411708    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 03 15:14:33.411731 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.411727    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 03 15:14:33.411841 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.411727    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 03 15:14:33.411953 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.411889    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ngfhc\""
Jul 03 15:14:33.413456 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.413435    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 03 15:14:33.422748 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.422546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:14:33.523947 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.523907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.523958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmx4m\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-kube-api-access-rmx4m\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524689 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524689 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524689 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524689 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524689 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524689 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524928 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.524928 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.524810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.625691 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.625985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmx4m\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-kube-api-access-rmx4m\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626810 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626810 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626810 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.626810 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.626261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.627772 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.627738    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.628272 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.628242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.628443 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.628291    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.628924 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.628896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.632715 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.629417    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.632715 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.630290    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.632715 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.632663    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-web-config\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.633780 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.633728    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.634311 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.634274    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.636543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.634487    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.636543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.635136    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.636543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.635477    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.636710 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.636547    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.636710 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.636637    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config-out\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.637286 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.637267    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.637691 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.637673    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.637889 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.637863    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.638476 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.638453    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.638717 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.638678    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.640057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.640032    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmx4m\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-kube-api-access-rmx4m\") pod \"prometheus-k8s-0\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:33.719293 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:33.719206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:14:39.545830 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.545725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc" event={"ID":"e3fc7c24-2100-43fe-9dd1-858d0947a80a","Type":"ContainerStarted","Data":"63cee059cd2cb053df3831a9468eccf1389c71821e4de8c83abb63bd6ff03354"}
Jul 03 15:14:39.555433 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.550133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bn4h5" event={"ID":"b96d80b8-a722-41aa-a7fb-2460b7e029df","Type":"ContainerStarted","Data":"e34dca3fa857a888a33eb958fc13437f4a8fda7d5cb2b391fd1712c949dd64c5"}
Jul 03 15:14:39.696772 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.696693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-659c9f7c5-d88rr"]
Jul 03 15:14:39.821183 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.821151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"]
Jul 03 15:14:39.824973 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.824896    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755886c6cd-9f9gm"]
Jul 03 15:14:39.832895 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.832790    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"]
Jul 03 15:14:39.834325 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.834240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:14:39.835637 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:39.835617    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:14:39.927554 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:39.927513    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfccf5cf_925f_4d60_9000_291c23bed4b2.slice/crio-44edfebdc5146532bd5fcf83109c5e363f5a5eb1a0c889d4af345cc1dbc39e74 WatchSource:0}: Error finding container 44edfebdc5146532bd5fcf83109c5e363f5a5eb1a0c889d4af345cc1dbc39e74: Status 404 returned error can't find the container with id 44edfebdc5146532bd5fcf83109c5e363f5a5eb1a0c889d4af345cc1dbc39e74
Jul 03 15:14:39.928457 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:39.928435    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02c3683_aa69_4f58_8ca7_4a0a7f965fac.slice/crio-c909a60a5aadcc44cb1ff75c2f05da509db54e4b8ddbea6549206730c3ec04ec WatchSource:0}: Error finding container c909a60a5aadcc44cb1ff75c2f05da509db54e4b8ddbea6549206730c3ec04ec: Status 404 returned error can't find the container with id c909a60a5aadcc44cb1ff75c2f05da509db54e4b8ddbea6549206730c3ec04ec
Jul 03 15:14:39.936980 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:14:39.934187    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcc94ff_126d_49d7_83d0_0c0d8e147b70.slice/crio-9d7295a2b350ddcc230f7997ff77ee44f250e3ab6278e56ac07f7aca30a8a02e WatchSource:0}: Error finding container 9d7295a2b350ddcc230f7997ff77ee44f250e3ab6278e56ac07f7aca30a8a02e: Status 404 returned error can't find the container with id 9d7295a2b350ddcc230f7997ff77ee44f250e3ab6278e56ac07f7aca30a8a02e
Jul 03 15:14:40.561968 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.561713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-49wb5" event={"ID":"f900f538-ee9c-40b9-b807-6e4211a788d5","Type":"ContainerStarted","Data":"8e8fb0d9f9d1d5040e00f4df4f3d473847c99ea1ff9b8e3769a2f278c87a09e6"}
Jul 03 15:14:40.565021 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.564923    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:40.569152 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.569123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr" event={"ID":"d02c3683-aa69-4f58-8ca7-4a0a7f965fac","Type":"ContainerStarted","Data":"c909a60a5aadcc44cb1ff75c2f05da509db54e4b8ddbea6549206730c3ec04ec"}
Jul 03 15:14:40.571171 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.571140    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755886c6cd-9f9gm" event={"ID":"fc34b155-a2d5-4559-bbcf-e608452e5d37","Type":"ContainerStarted","Data":"0acbc5ea811dbdcc9694bb6da546dbbf0a6c9e540d6621f36b0d00cc72770666"}
Jul 03 15:14:40.576080 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.576030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf" event={"ID":"ec5bbd33-21ef-49a8-acd9-c0e1503b19a2","Type":"ContainerStarted","Data":"606bad1298af6d0afd3dc6a6535e713bb6fd14b838249c4ba6f3a52b9a696ab6"}
Jul 03 15:14:40.577020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.576891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-49wb5"
Jul 03 15:14:40.584280 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.584249    2579 generic.go:356] "Generic (PLEG): container finished" podID="b96d80b8-a722-41aa-a7fb-2460b7e029df" containerID="e34dca3fa857a888a33eb958fc13437f4a8fda7d5cb2b391fd1712c949dd64c5" exitCode=0
Jul 03 15:14:40.584422 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.584336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bn4h5" event={"ID":"b96d80b8-a722-41aa-a7fb-2460b7e029df","Type":"ContainerDied","Data":"e34dca3fa857a888a33eb958fc13437f4a8fda7d5cb2b391fd1712c949dd64c5"}
Jul 03 15:14:40.591172 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.591091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"e80a6d86b3f8a7ce5a1a8e7e3693f169cd366b78b870817ca28a94bf7377f79e"}
Jul 03 15:14:40.594882 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.594853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z" event={"ID":"80735b42-cbc2-48e7-93dc-42a0fc6d005f","Type":"ContainerStarted","Data":"a24d44ade6ed3dca6886047b5fedb64c84cd98118cbc99e5a33983ba1f2a0b43"}
Jul 03 15:14:40.604990 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.604935    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-49wb5" podStartSLOduration=2.136512832 podStartE2EDuration="22.60491392s" totalImagesPullingTime="20.468401088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:40.583288116 +0000 UTC m=+81.057469722" watchObservedRunningTime="2026-07-03 15:14:40.60491392 +0000 UTC m=+81.079095527"
Jul 03 15:14:40.605703 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.605674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-df46w" event={"ID":"aa3456cd-4c64-4719-8dac-349a0d86c7f9","Type":"ContainerStarted","Data":"007f19d1a287b880c4f4a05a554dcb883ef0939e2677cf77716933e77ca74840"}
Jul 03 15:14:40.606395 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.606355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:14:40.608066 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.608039    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfqtr" event={"ID":"9b2cb4f8-3226-40f7-9e55-b4964c8aba30","Type":"ContainerStarted","Data":"23aa2354af0f9312ab7fd9853dc68a054aa8cad82b0dcb85a3631a8023476d7a"}
Jul 03 15:14:40.617634 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.617540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"44edfebdc5146532bd5fcf83109c5e363f5a5eb1a0c889d4af345cc1dbc39e74"}
Jul 03 15:14:40.624274 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.623668    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-2l9pf" podStartSLOduration=2.243365139 podStartE2EDuration="13.623634047s" totalImagesPullingTime="11.380268908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:40.605757288 +0000 UTC m=+81.079938894" watchObservedRunningTime="2026-07-03 15:14:40.623634047 +0000 UTC m=+81.097815650"
Jul 03 15:14:40.624274 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.623968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc" event={"ID":"e3fc7c24-2100-43fe-9dd1-858d0947a80a","Type":"ContainerStarted","Data":"af68ed112d0dc7537dbafac21984bebf518f73e2ed7269ad6dc8740b01d70e18"}
Jul 03 15:14:40.624274 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.624036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc" event={"ID":"e3fc7c24-2100-43fe-9dd1-858d0947a80a","Type":"ContainerStarted","Data":"46211a58b25eb0752e570740ed2473a0100b45eb0de0f6d35e040846d7f3cfdb"}
Jul 03 15:14:40.626482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.626456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"9d7295a2b350ddcc230f7997ff77ee44f250e3ab6278e56ac07f7aca30a8a02e"}
Jul 03 15:14:40.664513 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.663378    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kfqtr" podStartSLOduration=66.644774503 podStartE2EDuration="1m20.663338348s" totalImagesPullingTime="14.018563845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:40.662820819 +0000 UTC m=+81.137002424" watchObservedRunningTime="2026-07-03 15:14:40.663338348 +0000 UTC m=+81.137519931"
Jul 03 15:14:40.664513 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:40.663570    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-df46w" podStartSLOduration=66.640648465 podStartE2EDuration="1m20.663562717s" totalImagesPullingTime="14.022914252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:40.646852336 +0000 UTC m=+81.121033944" watchObservedRunningTime="2026-07-03 15:14:40.663562717 +0000 UTC m=+81.137744323"
Jul 03 15:14:41.652385 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:41.650694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bn4h5" event={"ID":"b96d80b8-a722-41aa-a7fb-2460b7e029df","Type":"ContainerStarted","Data":"193bef1f39765dfb681dba5917f046697d0bb6af858bf888e0888ddbd768a1c8"}
Jul 03 15:14:41.652385 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:41.650794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bn4h5" event={"ID":"b96d80b8-a722-41aa-a7fb-2460b7e029df","Type":"ContainerStarted","Data":"a3669e30874587a0cb18b40e7eb2095b7839f990d2d9a2fc37cbdb8f0f44c85d"}
Jul 03 15:14:41.671885 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:41.671829    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-b2hzc" podStartSLOduration=3.020536474 podStartE2EDuration="14.671806279s" totalImagesPullingTime="11.651269805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:40.70612858 +0000 UTC m=+81.180310184" watchObservedRunningTime="2026-07-03 15:14:41.671806279 +0000 UTC m=+82.145987885"
Jul 03 15:14:41.672593 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:41.672551    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bn4h5" podStartSLOduration=2.704524714 podStartE2EDuration="14.672511218s" totalImagesPullingTime="11.809901171s" totalInitContainerRuntime="158.085333ms" isStatefulPod=true podCreationTimestamp="2026-07-03 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:41.67021941 +0000 UTC m=+82.144401018" watchObservedRunningTime="2026-07-03 15:14:41.672511218 +0000 UTC m=+82.146692826"
Jul 03 15:14:44.688906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:44.688871    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755886c6cd-9f9gm"]
Jul 03 15:14:47.688760 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.688718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"3d9f026969c9adfa95c9c42bddb002c1bc617b6f9df1179de02f10faade07b75"}
Jul 03 15:14:47.689463 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.689436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"3e872608cce9cf7ad48df6b233e6b474c69c58cdc66a09f121e8d78c4410f9b0"}
Jul 03 15:14:47.689671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.689641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"64d04f1a362abf9ffa55e7f348d708cb54a79847b6dd12ffb78cd3ece4f0d4a1"}
Jul 03 15:14:47.690730 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.690694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr" event={"ID":"d02c3683-aa69-4f58-8ca7-4a0a7f965fac","Type":"ContainerStarted","Data":"2e4e7074bca3d4e4d881f4f1d7e6ffd31aa0682c4e20a24d15629526b2e7a125"}
Jul 03 15:14:47.692614 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.692588    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755886c6cd-9f9gm" event={"ID":"fc34b155-a2d5-4559-bbcf-e608452e5d37","Type":"ContainerStarted","Data":"d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0"}
Jul 03 15:14:47.694570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.694541    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="4c6f5bc8357b02b886048354cf4ca3f745496e45251f4535e6f0a719c26bd1a5" exitCode=0
Jul 03 15:14:47.694725 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.694625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"4c6f5bc8357b02b886048354cf4ca3f745496e45251f4535e6f0a719c26bd1a5"}
Jul 03 15:14:47.702225 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.701644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z" event={"ID":"80735b42-cbc2-48e7-93dc-42a0fc6d005f","Type":"ContainerStarted","Data":"f7d69616c4c244fc194819c433e50b6b29b4aabc28fb428569594d9ee96eab77"}
Jul 03 15:14:47.703580 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.702478    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:47.708498 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.708472    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98" exitCode=0
Jul 03 15:14:47.708801 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.708727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"}
Jul 03 15:14:47.709289 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.709237    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z"
Jul 03 15:14:47.744648 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.744581    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr" podStartSLOduration=9.882474339 podStartE2EDuration="16.744557667s" totalImagesPullingTime="6.862083328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:47.711657683 +0000 UTC m=+88.185839290" watchObservedRunningTime="2026-07-03 15:14:47.744557667 +0000 UTC m=+88.218739252"
Jul 03 15:14:47.784128 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.784059    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755886c6cd-9f9gm" podStartSLOduration=12.617303251 podStartE2EDuration="19.784038178s" totalImagesPullingTime="7.166734927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:47.782751014 +0000 UTC m=+88.256932619" watchObservedRunningTime="2026-07-03 15:14:47.784038178 +0000 UTC m=+88.258219783"
Jul 03 15:14:47.799224 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:47.799166    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4tt8z" podStartSLOduration=9.935537345 podStartE2EDuration="16.799145106s" totalImagesPullingTime="6.863607761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:47.797563609 +0000 UTC m=+88.271745219" watchObservedRunningTime="2026-07-03 15:14:47.799145106 +0000 UTC m=+88.273326710"
Jul 03 15:14:48.734183 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:48.734059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:14:49.722996 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:49.722954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"7f5986213069808188c2ad71c1713783fae059dcb03b412ac7a60a9586a5eeee"}
Jul 03 15:14:49.723199 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:49.723045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"0c593c4217936552cf47aa255d89fad264e197fbc3ab7cb96b75393b700652f3"}
Jul 03 15:14:49.723199 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:49.723086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" event={"ID":"adcc94ff-126d-49d7-83d0-0c0d8e147b70","Type":"ContainerStarted","Data":"b39915b6c9b655624b653cc2f59e2ee05a643e6bc5731e0f6b7fc6c5fe94fb58"}
Jul 03 15:14:49.748176 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:49.748110    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg" podStartSLOduration=11.522314797 podStartE2EDuration="19.748088969s" totalImagesPullingTime="8.225774172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:49.745758516 +0000 UTC m=+90.219940147" watchObservedRunningTime="2026-07-03 15:14:49.748088969 +0000 UTC m=+90.222270577"
Jul 03 15:14:50.730718 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:50.730677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"}
Jul 03 15:14:50.730890 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:50.730766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"}
Jul 03 15:14:50.731094 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:50.731069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:51.893089 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:51.893056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:51.893460 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:51.893156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:14:52.741428 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.741396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"}
Jul 03 15:14:52.741565 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.741463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"}
Jul 03 15:14:52.741565 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.741489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"}
Jul 03 15:14:52.741565 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.741522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerStarted","Data":"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"}
Jul 03 15:14:52.744352 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.744329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"8eca1bd466789e26e4700fa639f177d52eae10d87a82c38d394314833c8fd58c"}
Jul 03 15:14:52.744482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.744405    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"e2b6615c7e70b0b38d72181146833696a49629e5f8a1f5c5e358c4cee051cb16"}
Jul 03 15:14:52.744482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.744431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"d6dc45f384d3811c8784d079171c267d5f04968e2b7b4d8e6d6380cbf1bef047"}
Jul 03 15:14:52.744482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.744455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"70ed8687245adbe53497fc26aa211931135d04a36cf89ac41af6cdb266800374"}
Jul 03 15:14:52.744482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.744476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"b64f7a4d2196bdbff5b10265c88ed51ac4e85dcee6f384d7acd1c5a46d1c8700"}
Jul 03 15:14:52.776347 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:52.776298    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=15.295870197 podStartE2EDuration="24.776279294s" totalImagesPullingTime="9.455546942s" totalInitContainerRuntime="24.862155ms" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:52.773321238 +0000 UTC m=+93.247502854" watchObservedRunningTime="2026-07-03 15:14:52.776279294 +0000 UTC m=+93.250460899"
Jul 03 15:14:53.753564 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:53.753485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerStarted","Data":"387c83c92aa682be2f07fab1120c9ddb7dfbd6f0610b3e27ac8e581bb24bdb2c"}
Jul 03 15:14:53.784526 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:53.784456    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.49040349 podStartE2EDuration="20.784435088s" totalImagesPullingTime="11.261277215s" totalInitContainerRuntime="32.754383ms" isStatefulPod=false podCreationTimestamp="2026-07-03 15:14:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:14:53.781901831 +0000 UTC m=+94.256083436" watchObservedRunningTime="2026-07-03 15:14:53.784435088 +0000 UTC m=+94.258616694"
Jul 03 15:14:56.740692 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:56.740663    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5fd87bb5f8-t2dzg"
Jul 03 15:14:58.720347 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:14:58.720310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:11.899798 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:11.899766    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:15:11.903956 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:11.903928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-659c9f7c5-d88rr"
Jul 03 15:15:12.664241 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:12.664210    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-df46w"
Jul 03 15:15:12.723247 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:12.723201    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-755886c6cd-9f9gm" podUID="fc34b155-a2d5-4559-bbcf-e608452e5d37" containerName="console" containerID="cri-o://d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0" gracePeriod=15
Jul 03 15:15:13.065067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.065030    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:15:13.116400 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116345    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-config\") pod \"fc34b155-a2d5-4559-bbcf-e608452e5d37\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") "
Jul 03 15:15:13.116591 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116411    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-oauth-serving-cert\") pod \"fc34b155-a2d5-4559-bbcf-e608452e5d37\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") "
Jul 03 15:15:13.116591 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116476    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-oauth-config\") pod \"fc34b155-a2d5-4559-bbcf-e608452e5d37\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") "
Jul 03 15:15:13.116591 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb5fg\" (UniqueName: \"kubernetes.io/projected/fc34b155-a2d5-4559-bbcf-e608452e5d37-kube-api-access-gb5fg\") pod \"fc34b155-a2d5-4559-bbcf-e608452e5d37\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") "
Jul 03 15:15:13.116591 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116577    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-service-ca\") pod \"fc34b155-a2d5-4559-bbcf-e608452e5d37\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") "
Jul 03 15:15:13.116815 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116633    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-serving-cert\") pod \"fc34b155-a2d5-4559-bbcf-e608452e5d37\" (UID: \"fc34b155-a2d5-4559-bbcf-e608452e5d37\") "
Jul 03 15:15:13.116815 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116772    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-config" (OuterVolumeSpecName: "console-config") pod "fc34b155-a2d5-4559-bbcf-e608452e5d37" (UID: "fc34b155-a2d5-4559-bbcf-e608452e5d37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:13.116925 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.116807    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc34b155-a2d5-4559-bbcf-e608452e5d37" (UID: "fc34b155-a2d5-4559-bbcf-e608452e5d37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:13.117035 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.117010    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-config\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:13.117117 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.117041    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-oauth-serving-cert\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:13.117117 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.117052    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc34b155-a2d5-4559-bbcf-e608452e5d37" (UID: "fc34b155-a2d5-4559-bbcf-e608452e5d37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:13.119156 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.119132    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc34b155-a2d5-4559-bbcf-e608452e5d37" (UID: "fc34b155-a2d5-4559-bbcf-e608452e5d37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:13.119324 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.119306    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc34b155-a2d5-4559-bbcf-e608452e5d37" (UID: "fc34b155-a2d5-4559-bbcf-e608452e5d37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:13.119685 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.119651    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc34b155-a2d5-4559-bbcf-e608452e5d37-kube-api-access-gb5fg" (OuterVolumeSpecName: "kube-api-access-gb5fg") pod "fc34b155-a2d5-4559-bbcf-e608452e5d37" (UID: "fc34b155-a2d5-4559-bbcf-e608452e5d37"). InnerVolumeSpecName "kube-api-access-gb5fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:15:13.218348 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.218251    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-oauth-config\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:13.218348 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.218296    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb5fg\" (UniqueName: \"kubernetes.io/projected/fc34b155-a2d5-4559-bbcf-e608452e5d37-kube-api-access-gb5fg\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:13.218348 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.218313    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc34b155-a2d5-4559-bbcf-e608452e5d37-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:13.218348 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.218327    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc34b155-a2d5-4559-bbcf-e608452e5d37-console-serving-cert\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:13.841888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.841850    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc34b155-a2d5-4559-bbcf-e608452e5d37" containerID="d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0" exitCode=0
Jul 03 15:15:13.842057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.841899    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755886c6cd-9f9gm"
Jul 03 15:15:13.842057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.841898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755886c6cd-9f9gm" event={"ID":"fc34b155-a2d5-4559-bbcf-e608452e5d37","Type":"ContainerDied","Data":"d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0"}
Jul 03 15:15:13.842057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.842005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755886c6cd-9f9gm" event={"ID":"fc34b155-a2d5-4559-bbcf-e608452e5d37","Type":"ContainerDied","Data":"0acbc5ea811dbdcc9694bb6da546dbbf0a6c9e540d6621f36b0d00cc72770666"}
Jul 03 15:15:13.842057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.842029    2579 scope.go:117] "RemoveContainer" containerID="d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0"
Jul 03 15:15:13.855379 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.855339    2579 scope.go:117] "RemoveContainer" containerID="d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0"
Jul 03 15:15:13.855703 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:13.855683    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0\": container with ID starting with d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0 not found: ID does not exist" containerID="d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0"
Jul 03 15:15:13.855773 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.855709    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0"} err="failed to get container status \"d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0\": rpc error: code = NotFound desc = could not find container \"d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0\": container with ID starting with d04da1416f16c97f9d4484c1ac393a160a40f483e272c6490c3565ee369c12c0 not found: ID does not exist"
Jul 03 15:15:13.864512 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.864485    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-755886c6cd-9f9gm"]
Jul 03 15:15:13.868740 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:13.868713    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-755886c6cd-9f9gm"]
Jul 03 15:15:14.009798 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:14.009765    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc34b155-a2d5-4559-bbcf-e608452e5d37" path="/var/lib/kubelet/pods/fc34b155-a2d5-4559-bbcf-e608452e5d37/volumes"
Jul 03 15:15:33.720336 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:33.720297    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:33.801435 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:33.801399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:33.941841 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:33.941810    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:47.431847 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.431810    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:15:47.432255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.432101    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="alertmanager" containerID="cri-o://4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37" gracePeriod=120
Jul 03 15:15:47.432255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.432185    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-web" containerID="cri-o://c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64" gracePeriod=120
Jul 03 15:15:47.432255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.432186    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-metric" containerID="cri-o://3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac" gracePeriod=120
Jul 03 15:15:47.432255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.432229    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="config-reloader" containerID="cri-o://f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf" gracePeriod=120
Jul 03 15:15:47.432503 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.432294    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="prom-label-proxy" containerID="cri-o://3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c" gracePeriod=120
Jul 03 15:15:47.432503 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.432213    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy" containerID="cri-o://67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d" gracePeriod=120
Jul 03 15:15:47.982505 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982468    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c" exitCode=0
Jul 03 15:15:47.982505 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982494    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d" exitCode=0
Jul 03 15:15:47.982505 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982500    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf" exitCode=0
Jul 03 15:15:47.982505 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982506    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37" exitCode=0
Jul 03 15:15:47.982840 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982543    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"}
Jul 03 15:15:47.982840 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982660    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"}
Jul 03 15:15:47.982840 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"}
Jul 03 15:15:47.982840 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:47.982743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"}
Jul 03 15:15:48.667543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.667514    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:48.841504 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-cluster-tls-config\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841504 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841455    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-metrics-client-ca\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841504 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841478    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-tls-assets\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841568    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-volume\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-main-db\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841663    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-web-config\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.841824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841696    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jczht\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-kube-api-access-jczht\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.842175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841862    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:48.842175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841887    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.842175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841948    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.842175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.841974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-out\") pod \"bfccf5cf-925f-4d60-9000-291c23bed4b2\" (UID: \"bfccf5cf-925f-4d60-9000-291c23bed4b2\") "
Jul 03 15:15:48.842175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.842136    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 15:15:48.842628 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.842291    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-metrics-client-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.842628 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.842312    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-main-db\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.842733 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.842646    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:48.846413 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846350    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-kube-api-access-jczht" (OuterVolumeSpecName: "kube-api-access-jczht") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "kube-api-access-jczht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:15:48.846413 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846379    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.846595 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846505    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-volume" (OuterVolumeSpecName: "config-volume") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.846595 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846572    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:15:48.846786 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846755    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-out" (OuterVolumeSpecName: "config-out") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 15:15:48.846891 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846762    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.846933 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846896    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.847013 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.846989    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.850088 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.849990    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.856636 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.856615    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-web-config" (OuterVolumeSpecName: "web-config") pod "bfccf5cf-925f-4d60-9000-291c23bed4b2" (UID: "bfccf5cf-925f-4d60-9000-291c23bed4b2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:48.943006 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.942977    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-tls-assets\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943006 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943005    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943015    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943026    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-volume\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943034    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfccf5cf-925f-4d60-9000-291c23bed4b2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943064    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-web-config\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943072    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jczht\" (UniqueName: \"kubernetes.io/projected/bfccf5cf-925f-4d60-9000-291c23bed4b2-kube-api-access-jczht\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943080    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943090    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-secret-alertmanager-main-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943100    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfccf5cf-925f-4d60-9000-291c23bed4b2-config-out\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.943185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.943109    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bfccf5cf-925f-4d60-9000-291c23bed4b2-cluster-tls-config\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:48.990078 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990041    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac" exitCode=0
Jul 03 15:15:48.990078 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990069    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerID="c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64" exitCode=0
Jul 03 15:15:48.990267 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"}
Jul 03 15:15:48.990267 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990120    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:48.990267 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"}
Jul 03 15:15:48.990267 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990186    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bfccf5cf-925f-4d60-9000-291c23bed4b2","Type":"ContainerDied","Data":"44edfebdc5146532bd5fcf83109c5e363f5a5eb1a0c889d4af345cc1dbc39e74"}
Jul 03 15:15:48.990267 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.990217    2579 scope.go:117] "RemoveContainer" containerID="3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"
Jul 03 15:15:48.999002 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:48.998984    2579 scope.go:117] "RemoveContainer" containerID="3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"
Jul 03 15:15:49.006429 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.006404    2579 scope.go:117] "RemoveContainer" containerID="67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"
Jul 03 15:15:49.014298 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.014253    2579 scope.go:117] "RemoveContainer" containerID="c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"
Jul 03 15:15:49.016512 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.016488    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:15:49.020227 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.020199    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:15:49.024890 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.024870    2579 scope.go:117] "RemoveContainer" containerID="f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"
Jul 03 15:15:49.032194 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.032178    2579 scope.go:117] "RemoveContainer" containerID="4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"
Jul 03 15:15:49.040305 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.040287    2579 scope.go:117] "RemoveContainer" containerID="6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"
Jul 03 15:15:49.047670 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.047642    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:15:49.048134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048112    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="init-config-reloader"
Jul 03 15:15:49.048134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048133    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="init-config-reloader"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048166    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048176    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048188    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc34b155-a2d5-4559-bbcf-e608452e5d37" containerName="console"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048196    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc34b155-a2d5-4559-bbcf-e608452e5d37" containerName="console"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048206    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="alertmanager"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048213    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="alertmanager"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048228    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="config-reloader"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048236    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="config-reloader"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048246    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-web"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048254    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-web"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048267    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-metric"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048275    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-metric"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048287    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="prom-label-proxy"
Jul 03 15:15:49.048288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048294    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="prom-label-proxy"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048429    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="alertmanager"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048441    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="prom-label-proxy"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048453    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc34b155-a2d5-4559-bbcf-e608452e5d37" containerName="console"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048463    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-metric"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048472    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="config-reloader"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048482    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy-web"
Jul 03 15:15:49.049173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.048492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" containerName="kube-rbac-proxy"
Jul 03 15:15:49.049695 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.049679    2579 scope.go:117] "RemoveContainer" containerID="3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"
Jul 03 15:15:49.050013 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.049990    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c\": container with ID starting with 3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c not found: ID does not exist" containerID="3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"
Jul 03 15:15:49.050086 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050028    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"} err="failed to get container status \"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c\": rpc error: code = NotFound desc = could not find container \"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c\": container with ID starting with 3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c not found: ID does not exist"
Jul 03 15:15:49.050086 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050052    2579 scope.go:117] "RemoveContainer" containerID="3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"
Jul 03 15:15:49.050352 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.050329    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac\": container with ID starting with 3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac not found: ID does not exist" containerID="3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"
Jul 03 15:15:49.050428 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050385    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"} err="failed to get container status \"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac\": rpc error: code = NotFound desc = could not find container \"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac\": container with ID starting with 3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac not found: ID does not exist"
Jul 03 15:15:49.050428 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050403    2579 scope.go:117] "RemoveContainer" containerID="67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"
Jul 03 15:15:49.050627 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.050605    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d\": container with ID starting with 67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d not found: ID does not exist" containerID="67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"
Jul 03 15:15:49.050720 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050627    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"} err="failed to get container status \"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d\": rpc error: code = NotFound desc = could not find container \"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d\": container with ID starting with 67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d not found: ID does not exist"
Jul 03 15:15:49.050720 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050641    2579 scope.go:117] "RemoveContainer" containerID="c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"
Jul 03 15:15:49.050888 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.050872    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64\": container with ID starting with c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64 not found: ID does not exist" containerID="c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"
Jul 03 15:15:49.050927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050892    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"} err="failed to get container status \"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64\": rpc error: code = NotFound desc = could not find container \"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64\": container with ID starting with c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64 not found: ID does not exist"
Jul 03 15:15:49.050927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.050904    2579 scope.go:117] "RemoveContainer" containerID="f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"
Jul 03 15:15:49.051146 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.051123    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf\": container with ID starting with f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf not found: ID does not exist" containerID="f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"
Jul 03 15:15:49.051200 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051151    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"} err="failed to get container status \"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf\": rpc error: code = NotFound desc = could not find container \"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf\": container with ID starting with f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf not found: ID does not exist"
Jul 03 15:15:49.051200 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051166    2579 scope.go:117] "RemoveContainer" containerID="4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"
Jul 03 15:15:49.051417 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.051399    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37\": container with ID starting with 4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37 not found: ID does not exist" containerID="4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"
Jul 03 15:15:49.051472 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051421    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"} err="failed to get container status \"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37\": rpc error: code = NotFound desc = could not find container \"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37\": container with ID starting with 4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37 not found: ID does not exist"
Jul 03 15:15:49.051472 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051433    2579 scope.go:117] "RemoveContainer" containerID="6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"
Jul 03 15:15:49.051660 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:15:49.051644    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98\": container with ID starting with 6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98 not found: ID does not exist" containerID="6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"
Jul 03 15:15:49.051705 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051667    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"} err="failed to get container status \"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98\": rpc error: code = NotFound desc = could not find container \"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98\": container with ID starting with 6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98 not found: ID does not exist"
Jul 03 15:15:49.051705 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051679    2579 scope.go:117] "RemoveContainer" containerID="3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"
Jul 03 15:15:49.051904 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051884    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c"} err="failed to get container status \"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c\": rpc error: code = NotFound desc = could not find container \"3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c\": container with ID starting with 3cd78de400ca456045dccf9e2a2d347870eade6cb05658a67657bdc50f7ce81c not found: ID does not exist"
Jul 03 15:15:49.051963 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.051907    2579 scope.go:117] "RemoveContainer" containerID="3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"
Jul 03 15:15:49.052178 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052159    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac"} err="failed to get container status \"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac\": rpc error: code = NotFound desc = could not find container \"3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac\": container with ID starting with 3b410fb2395445df399f25d66fff7c8de7ce096483c44cd75e86b6195d18f3ac not found: ID does not exist"
Jul 03 15:15:49.052255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052181    2579 scope.go:117] "RemoveContainer" containerID="67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"
Jul 03 15:15:49.052426 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052411    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.052485 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052438    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d"} err="failed to get container status \"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d\": rpc error: code = NotFound desc = could not find container \"67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d\": container with ID starting with 67c7f299cfd6d10c7e9c5514ff80869ed2c1812ada5cf5f25b1e34e6b177a53d not found: ID does not exist"
Jul 03 15:15:49.052485 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052472    2579 scope.go:117] "RemoveContainer" containerID="c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"
Jul 03 15:15:49.052724 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052700    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64"} err="failed to get container status \"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64\": rpc error: code = NotFound desc = could not find container \"c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64\": container with ID starting with c439edb3e54c535511b022ea9185656f5f9b2682182ced6d08c4bc581b36ad64 not found: ID does not exist"
Jul 03 15:15:49.052792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052727    2579 scope.go:117] "RemoveContainer" containerID="f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"
Jul 03 15:15:49.053015 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.052994    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf"} err="failed to get container status \"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf\": rpc error: code = NotFound desc = could not find container \"f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf\": container with ID starting with f46cc903106c6edf93a5c992bc2c638faa7816c7ec5c011c6c03325de5be34bf not found: ID does not exist"
Jul 03 15:15:49.053015 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.053015    2579 scope.go:117] "RemoveContainer" containerID="4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"
Jul 03 15:15:49.053239 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.053221    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37"} err="failed to get container status \"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37\": rpc error: code = NotFound desc = could not find container \"4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37\": container with ID starting with 4bd05be1f8ac1391dd6bfa0106a1601cf4b77e0ef8672694ff424ae4f954fb37 not found: ID does not exist"
Jul 03 15:15:49.053285 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.053240    2579 scope.go:117] "RemoveContainer" containerID="6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"
Jul 03 15:15:49.053562 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.053542    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98"} err="failed to get container status \"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98\": rpc error: code = NotFound desc = could not find container \"6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98\": container with ID starting with 6f80df4890937e49a2d1e5fdb5d28caaa75e4602e5be18ffc343b6dafdaa1e98 not found: ID does not exist"
Jul 03 15:15:49.055112 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rvk7h\""
Jul 03 15:15:49.055185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055111    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 03 15:15:49.055247 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055111    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 03 15:15:49.055301 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 03 15:15:49.055429 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055412    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 03 15:15:49.055556 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055523    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 03 15:15:49.055556 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055529    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 03 15:15:49.055790 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055774    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 03 15:15:49.055868 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.055812    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 03 15:15:49.060681 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.060663    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 03 15:15:49.064953 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.064929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:15:49.144584 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3f28af-241a-43a0-abef-a28c8bd297b9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.144789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-web-config\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.144789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3f28af-241a-43a0-abef-a28c8bd297b9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.144789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.144789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.144789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3f28af-241a-43a0-abef-a28c8bd297b9-config-out\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.144789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3f28af-241a-43a0-abef-a28c8bd297b9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.145102 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3f28af-241a-43a0-abef-a28c8bd297b9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.145102 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpz8d\" (UniqueName: \"kubernetes.io/projected/ff3f28af-241a-43a0-abef-a28c8bd297b9-kube-api-access-bpz8d\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.145102 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.145102 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.145102 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.144997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.145102 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.145025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3f28af-241a-43a0-abef-a28c8bd297b9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-web-config\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3f28af-241a-43a0-abef-a28c8bd297b9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3f28af-241a-43a0-abef-a28c8bd297b9-config-out\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3f28af-241a-43a0-abef-a28c8bd297b9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3f28af-241a-43a0-abef-a28c8bd297b9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpz8d\" (UniqueName: \"kubernetes.io/projected/ff3f28af-241a-43a0-abef-a28c8bd297b9-kube-api-access-bpz8d\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.246750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.247138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.247138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.247138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.246848    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.247296 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.247264    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3f28af-241a-43a0-abef-a28c8bd297b9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.247749 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.247721    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3f28af-241a-43a0-abef-a28c8bd297b9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.249955 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.249926    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250057 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.249987    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250128 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250065    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3f28af-241a-43a0-abef-a28c8bd297b9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250128 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250083    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250222 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250173    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-web-config\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250222 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250210    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3f28af-241a-43a0-abef-a28c8bd297b9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250308 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250385 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250308    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3f28af-241a-43a0-abef-a28c8bd297b9-config-out\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.250431 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.250417    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.252016 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.251999    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ff3f28af-241a-43a0-abef-a28c8bd297b9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.258458 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.258437    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpz8d\" (UniqueName: \"kubernetes.io/projected/ff3f28af-241a-43a0-abef-a28c8bd297b9-kube-api-access-bpz8d\") pod \"alertmanager-main-0\" (UID: \"ff3f28af-241a-43a0-abef-a28c8bd297b9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.362383 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.362318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 15:15:49.499877 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.499853    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 15:15:49.502750 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:15:49.502715    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3f28af_241a_43a0_abef_a28c8bd297b9.slice/crio-cc5bd52e87c806213c14ec831a8cfd8d6dfba8e73a5be1ca0e9d83c4248e59d0 WatchSource:0}: Error finding container cc5bd52e87c806213c14ec831a8cfd8d6dfba8e73a5be1ca0e9d83c4248e59d0: Status 404 returned error can't find the container with id cc5bd52e87c806213c14ec831a8cfd8d6dfba8e73a5be1ca0e9d83c4248e59d0
Jul 03 15:15:49.995300 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.995266    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff3f28af-241a-43a0-abef-a28c8bd297b9" containerID="1739ca017c42784a567fda215141cec1e92a431ed659254dd66acdde65c16f95" exitCode=0
Jul 03 15:15:49.995792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.995384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerDied","Data":"1739ca017c42784a567fda215141cec1e92a431ed659254dd66acdde65c16f95"}
Jul 03 15:15:49.995792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:49.995505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"cc5bd52e87c806213c14ec831a8cfd8d6dfba8e73a5be1ca0e9d83c4248e59d0"}
Jul 03 15:15:50.010215 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:50.009564    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfccf5cf-925f-4d60-9000-291c23bed4b2" path="/var/lib/kubelet/pods/bfccf5cf-925f-4d60-9000-291c23bed4b2/volumes"
Jul 03 15:15:51.003255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.003222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"be6a5fc24c917437c6414c2cbbc4363090cc5820df4955a0484865f3d70b4712"}
Jul 03 15:15:51.003737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.003283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"f548a565c50a0a0fb53192300a96051392d34bc6d087dcb0f1acdcf815b623c1"}
Jul 03 15:15:51.003737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.003320    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"ec54e501dd55efcf9a05b1036dfeab05ac45e91dd29655a14407c1cb712b18dd"}
Jul 03 15:15:51.003737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.003345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"4ce9fc391139a1494e7f0c12df22bc9a460399262a3872dd7a3d416eead29a09"}
Jul 03 15:15:51.003737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.003385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"54ee97d65b2c74bb0557e8c9b0c665bab9929a7d159503663af3716b24969a42"}
Jul 03 15:15:51.003737 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.003408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ff3f28af-241a-43a0-abef-a28c8bd297b9","Type":"ContainerStarted","Data":"d51edcb46f049251f250154608a6c65dff6650f0bb9ce9625bf19c8a79030296"}
Jul 03 15:15:51.031844 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.031739    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.01398862 podStartE2EDuration="2.031713671s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.725051ms" isStatefulPod=false podCreationTimestamp="2026-07-03 15:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:15:51.030379485 +0000 UTC m=+151.504561091" watchObservedRunningTime="2026-07-03 15:15:51.031713671 +0000 UTC m=+151.505895324"
Jul 03 15:15:51.457747 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.456815    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"]
Jul 03 15:15:51.459678 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.459661    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.462588 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.462562    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 03 15:15:51.462894 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.462831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 03 15:15:51.462894 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.462863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 03 15:15:51.463047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.462936    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 03 15:15:51.463047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.462875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qw299\""
Jul 03 15:15:51.463047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.462884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 03 15:15:51.474591 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.471928    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 03 15:15:51.479425 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.479395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"]
Jul 03 15:15:51.567135 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8nxv\" (UniqueName: \"kubernetes.io/projected/be9c90bd-cb03-45d5-b202-d90e2fd80d89-kube-api-access-p8nxv\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567303 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567303 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567303 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-serving-certs-ca-bundle\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567421 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-telemeter-client-tls\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567421 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-secret-telemeter-client\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-metrics-client-ca\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.567482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.567470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-federate-client-tls\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668387 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-federate-client-tls\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8nxv\" (UniqueName: \"kubernetes.io/projected/be9c90bd-cb03-45d5-b202-d90e2fd80d89-kube-api-access-p8nxv\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-serving-certs-ca-bundle\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-telemeter-client-tls\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668857 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-secret-telemeter-client\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.668857 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.668803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-metrics-client-ca\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.669963 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.669929    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.670542 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.670514    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-metrics-client-ca\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.671252 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.671060    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9c90bd-cb03-45d5-b202-d90e2fd80d89-serving-certs-ca-bundle\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.672005 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.671953    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.672154 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.672123    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-telemeter-client-tls\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.672889 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.672864    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-federate-client-tls\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.673541 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.673520    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be9c90bd-cb03-45d5-b202-d90e2fd80d89-secret-telemeter-client\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.677207 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.677181    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8nxv\" (UniqueName: \"kubernetes.io/projected/be9c90bd-cb03-45d5-b202-d90e2fd80d89-kube-api-access-p8nxv\") pod \"telemeter-client-86664cf6b9-9sbgq\" (UID: \"be9c90bd-cb03-45d5-b202-d90e2fd80d89\") " pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.750674 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.750585    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:15:51.751022 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.750987    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="prometheus" containerID="cri-o://b64f7a4d2196bdbff5b10265c88ed51ac4e85dcee6f384d7acd1c5a46d1c8700" gracePeriod=600
Jul 03 15:15:51.751118 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.751023    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="thanos-sidecar" containerID="cri-o://d6dc45f384d3811c8784d079171c267d5f04968e2b7b4d8e6d6380cbf1bef047" gracePeriod=600
Jul 03 15:15:51.751177 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.751065    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="config-reloader" containerID="cri-o://70ed8687245adbe53497fc26aa211931135d04a36cf89ac41af6cdb266800374" gracePeriod=600
Jul 03 15:15:51.751177 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.751026    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy" containerID="cri-o://8eca1bd466789e26e4700fa639f177d52eae10d87a82c38d394314833c8fd58c" gracePeriod=600
Jul 03 15:15:51.751276 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.751040    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-web" containerID="cri-o://e2b6615c7e70b0b38d72181146833696a49629e5f8a1f5c5e358c4cee051cb16" gracePeriod=600
Jul 03 15:15:51.751825 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.751390    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-thanos" containerID="cri-o://387c83c92aa682be2f07fab1120c9ddb7dfbd6f0610b3e27ac8e581bb24bdb2c" gracePeriod=600
Jul 03 15:15:51.775946 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.775913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"
Jul 03 15:15:51.943624 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:51.943599    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86664cf6b9-9sbgq"]
Jul 03 15:15:51.946718 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:15:51.946692    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9c90bd_cb03_45d5_b202_d90e2fd80d89.slice/crio-b6d1ecaa1fd85ef663c57c307823fc9265bd6636391d791d49750e288d8f2911 WatchSource:0}: Error finding container b6d1ecaa1fd85ef663c57c307823fc9265bd6636391d791d49750e288d8f2911: Status 404 returned error can't find the container with id b6d1ecaa1fd85ef663c57c307823fc9265bd6636391d791d49750e288d8f2911
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013113    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="387c83c92aa682be2f07fab1120c9ddb7dfbd6f0610b3e27ac8e581bb24bdb2c" exitCode=0
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013145    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="8eca1bd466789e26e4700fa639f177d52eae10d87a82c38d394314833c8fd58c" exitCode=0
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013155    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="e2b6615c7e70b0b38d72181146833696a49629e5f8a1f5c5e358c4cee051cb16" exitCode=0
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013163    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="d6dc45f384d3811c8784d079171c267d5f04968e2b7b4d8e6d6380cbf1bef047" exitCode=0
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013173    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="70ed8687245adbe53497fc26aa211931135d04a36cf89ac41af6cdb266800374" exitCode=0
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013182    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerID="b64f7a4d2196bdbff5b10265c88ed51ac4e85dcee6f384d7acd1c5a46d1c8700" exitCode=0
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"387c83c92aa682be2f07fab1120c9ddb7dfbd6f0610b3e27ac8e581bb24bdb2c"}
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"8eca1bd466789e26e4700fa639f177d52eae10d87a82c38d394314833c8fd58c"}
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"e2b6615c7e70b0b38d72181146833696a49629e5f8a1f5c5e358c4cee051cb16"}
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"d6dc45f384d3811c8784d079171c267d5f04968e2b7b4d8e6d6380cbf1bef047"}
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013480    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"70ed8687245adbe53497fc26aa211931135d04a36cf89ac41af6cdb266800374"}
Jul 03 15:15:52.015042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.013516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"b64f7a4d2196bdbff5b10265c88ed51ac4e85dcee6f384d7acd1c5a46d1c8700"}
Jul 03 15:15:52.015921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.015350    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq" event={"ID":"be9c90bd-cb03-45d5-b202-d90e2fd80d89","Type":"ContainerStarted","Data":"b6d1ecaa1fd85ef663c57c307823fc9265bd6636391d791d49750e288d8f2911"}
Jul 03 15:15:52.018911 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.018891    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:52.174295 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174259    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-kube-rbac-proxy\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174338    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-kubelet-serving-ca-bundle\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174395    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-grpc-tls\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-metrics-client-certs\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174482 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174446    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-1\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174484    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-serving-certs-ca-bundle\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174578    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-0\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174602    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-tls\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174627    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-2\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174666    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-web-config\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174690    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174719    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-db\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174742    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-thanos-prometheus-http-client-file\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174847    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-tls-assets\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174856    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmx4m\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-kube-api-access-rmx4m\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-metrics-client-ca\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.174967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.174961    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config-out\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.175977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.175012    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-trusted-ca-bundle\") pod \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\" (UID: \"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce\") "
Jul 03 15:15:52.175977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.175539    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.175977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.175692    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.175977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.175714    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.175977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.175727    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.175977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.175793    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.176286 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.176270    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.178286 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.177178    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.178286 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.177579    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.178286 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.177864    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:15:52.178803 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.178755    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 15:15:52.178917 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.178823    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.179023 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.179002    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.179089 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.179055    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:15:52.179546 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.179523    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.179634 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.179596    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.179844 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.179812    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.180295 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.180245    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.180514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.180490    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config" (OuterVolumeSpecName: "config") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.180989 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.180957    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-kube-api-access-rmx4m" (OuterVolumeSpecName: "kube-api-access-rmx4m") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "kube-api-access-rmx4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:15:52.181067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.181020    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config-out" (OuterVolumeSpecName: "config-out") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 15:15:52.191500 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.191466    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-web-config" (OuterVolumeSpecName: "web-config") pod "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" (UID: "d2571c1e-95d4-4545-bf03-1ee4ac8b54ce"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:15:52.276996 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.276916    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.276996 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.276946    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.276996 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.276956    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.276996 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.276989    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-web-config\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.276996 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.276997    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277005    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-k8s-db\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277014    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277022    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-tls-assets\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277030    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmx4m\" (UniqueName: \"kubernetes.io/projected/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-kube-api-access-rmx4m\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277038    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-configmap-metrics-client-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277046    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-config-out\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277054    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277061    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-kube-rbac-proxy\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277069    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-grpc-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277077    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-metrics-client-certs\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277085    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:52.277255 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:52.277095    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:15:53.026154 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.026067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d2571c1e-95d4-4545-bf03-1ee4ac8b54ce","Type":"ContainerDied","Data":"e80a6d86b3f8a7ce5a1a8e7e3693f169cd366b78b870817ca28a94bf7377f79e"}
Jul 03 15:15:53.026630 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.026155    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.026630 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.026170    2579 scope.go:117] "RemoveContainer" containerID="387c83c92aa682be2f07fab1120c9ddb7dfbd6f0610b3e27ac8e581bb24bdb2c"
Jul 03 15:15:53.035728 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.035704    2579 scope.go:117] "RemoveContainer" containerID="8eca1bd466789e26e4700fa639f177d52eae10d87a82c38d394314833c8fd58c"
Jul 03 15:15:53.044686 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.044661    2579 scope.go:117] "RemoveContainer" containerID="e2b6615c7e70b0b38d72181146833696a49629e5f8a1f5c5e358c4cee051cb16"
Jul 03 15:15:53.053389 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.053348    2579 scope.go:117] "RemoveContainer" containerID="d6dc45f384d3811c8784d079171c267d5f04968e2b7b4d8e6d6380cbf1bef047"
Jul 03 15:15:53.054712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.054626    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:15:53.062330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.062201    2579 scope.go:117] "RemoveContainer" containerID="70ed8687245adbe53497fc26aa211931135d04a36cf89ac41af6cdb266800374"
Jul 03 15:15:53.062504 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.062483    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:15:53.069965 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.069944    2579 scope.go:117] "RemoveContainer" containerID="b64f7a4d2196bdbff5b10265c88ed51ac4e85dcee6f384d7acd1c5a46d1c8700"
Jul 03 15:15:53.077671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.077650    2579 scope.go:117] "RemoveContainer" containerID="4c6f5bc8357b02b886048354cf4ca3f745496e45251f4535e6f0a719c26bd1a5"
Jul 03 15:15:53.088816 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.088796    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:15:53.089108 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089094    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089110    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089118    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-web"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089123    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-web"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089132    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="init-config-reloader"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089137    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="init-config-reloader"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089147    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="prometheus"
Jul 03 15:15:53.089153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089152    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="prometheus"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089157    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="config-reloader"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089162    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="config-reloader"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089169    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-thanos"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089174    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-thanos"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089190    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="thanos-sidecar"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089194    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="thanos-sidecar"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089246    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="thanos-sidecar"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089256    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-thanos"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089262    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="prometheus"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089268    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089273    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="config-reloader"
Jul 03 15:15:53.089442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.089279    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" containerName="kube-rbac-proxy-web"
Jul 03 15:15:53.092821 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.092804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.095817 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.095795    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 03 15:15:53.095927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.095865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 03 15:15:53.096006 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.095909    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 03 15:15:53.096104 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096087    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 03 15:15:53.096104 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096097    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eu9lovbvg4sos\""
Jul 03 15:15:53.096342 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096323    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 03 15:15:53.096342 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096340    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 03 15:15:53.096479 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096347    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 03 15:15:53.096479 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096378    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 03 15:15:53.096479 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096350    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 03 15:15:53.096878 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096860    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 03 15:15:53.097023 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.096989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 03 15:15:53.097162 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.097144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ngfhc\""
Jul 03 15:15:53.100216 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.097771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 03 15:15:53.103898 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.103878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 03 15:15:53.106403 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.106380    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 03 15:15:53.108907 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.108881    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:15:53.286391 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286391 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/719e2246-8eaf-4316-9639-45780f12d93b-config-out\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286391 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-web-config\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/719e2246-8eaf-4316-9639-45780f12d93b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.286914 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.287175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-config\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.287175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.287175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.286991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gs4\" (UniqueName: \"kubernetes.io/projected/719e2246-8eaf-4316-9639-45780f12d93b-kube-api-access-w7gs4\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387593 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-web-config\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/719e2246-8eaf-4316-9639-45780f12d93b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387742    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.387779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-config\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gs4\" (UniqueName: \"kubernetes.io/projected/719e2246-8eaf-4316-9639-45780f12d93b-kube-api-access-w7gs4\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.387971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/719e2246-8eaf-4316-9639-45780f12d93b-config-out\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388092 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388709 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388709 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388163    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388709 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388510    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.388709 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.388615    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.390333 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.389242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.390333 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.389428    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.390333 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.389983    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.390333 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.390159    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.390709 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.390682    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.391674 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.391648    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/719e2246-8eaf-4316-9639-45780f12d93b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.392528 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.392500    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/719e2246-8eaf-4316-9639-45780f12d93b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.393554 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.393508    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-config\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.393653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.393589    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.393653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.393625    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-web-config\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.393653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.393641    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.394123 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.394081    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.394487 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.394381    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.394487 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.394419    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.394880 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.394858    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.395477 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.395435    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/719e2246-8eaf-4316-9639-45780f12d93b-config-out\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.396247 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.396227    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/719e2246-8eaf-4316-9639-45780f12d93b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.397785 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.397754    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gs4\" (UniqueName: \"kubernetes.io/projected/719e2246-8eaf-4316-9639-45780f12d93b-kube-api-access-w7gs4\") pod \"prometheus-k8s-0\" (UID: \"719e2246-8eaf-4316-9639-45780f12d93b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.405743 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.405721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:15:53.914316 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:53.914288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 15:15:53.914974 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:15:53.914948    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719e2246_8eaf_4316_9639_45780f12d93b.slice/crio-480d1a3d191e490b07033b69d5d862eeef96399497ffc0765e5e19067d509e34 WatchSource:0}: Error finding container 480d1a3d191e490b07033b69d5d862eeef96399497ffc0765e5e19067d509e34: Status 404 returned error can't find the container with id 480d1a3d191e490b07033b69d5d862eeef96399497ffc0765e5e19067d509e34
Jul 03 15:15:54.010796 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.010760    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2571c1e-95d4-4545-bf03-1ee4ac8b54ce" path="/var/lib/kubelet/pods/d2571c1e-95d4-4545-bf03-1ee4ac8b54ce/volumes"
Jul 03 15:15:54.033687 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.033593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq" event={"ID":"be9c90bd-cb03-45d5-b202-d90e2fd80d89","Type":"ContainerStarted","Data":"0a23811346795997e044fe225a851e334828fdedf8bd9329d63d877c140e8e11"}
Jul 03 15:15:54.033687 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.033667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq" event={"ID":"be9c90bd-cb03-45d5-b202-d90e2fd80d89","Type":"ContainerStarted","Data":"a4831f9af3eea0d4f12d76c51314e293029ebc375bca36981822192c1dfab31c"}
Jul 03 15:15:54.034127 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.033699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq" event={"ID":"be9c90bd-cb03-45d5-b202-d90e2fd80d89","Type":"ContainerStarted","Data":"7b552a91aa42b64767ccf19f534f39de3dbb685a2c6ffb70cb32ee1326d7ddb1"}
Jul 03 15:15:54.035042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.035014    2579 generic.go:356] "Generic (PLEG): container finished" podID="719e2246-8eaf-4316-9639-45780f12d93b" containerID="c3504ec47f4b872768a0731903c10b909bea6d7aeb4a0e7b64c3e283eca38f5f" exitCode=0
Jul 03 15:15:54.035166 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.035067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerDied","Data":"c3504ec47f4b872768a0731903c10b909bea6d7aeb4a0e7b64c3e283eca38f5f"}
Jul 03 15:15:54.035166 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.035117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"480d1a3d191e490b07033b69d5d862eeef96399497ffc0765e5e19067d509e34"}
Jul 03 15:15:54.057959 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:54.057916    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86664cf6b9-9sbgq" podStartSLOduration=1.2096021399999999 podStartE2EDuration="3.057899709s" totalImagesPullingTime="1.848297569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:15:54.057473255 +0000 UTC m=+154.531654862" watchObservedRunningTime="2026-07-03 15:15:54.057899709 +0000 UTC m=+154.532081313"
Jul 03 15:15:55.043300 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.043264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"9af84a498fde65a2c49790fdb22403bd3cf8c3fa0cf02fdf3e38452cb7584ea8"}
Jul 03 15:15:55.043711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.043331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"e91aa4fa73251492db62833b1a628d9bbfdecec0eff79af19e7d760c0810f9a8"}
Jul 03 15:15:55.043711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.043356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"8c7edbcb58622641dc51fd8923a9ad213b98fd26aa0cfda593b1fd30c0c8cd9b"}
Jul 03 15:15:55.043711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.043395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"d39d4dfd500c2e72de0028c9effb67aabdb0714ad9ba95ce99fdcd1885c11066"}
Jul 03 15:15:55.043711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.043419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"0564e3ff3e4f26b5f26d5e56c33ab45e4132e4654b581279aef412a1636d63c6"}
Jul 03 15:15:55.043711 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.043442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"719e2246-8eaf-4316-9639-45780f12d93b","Type":"ContainerStarted","Data":"b9aee06353c2faab26bac6d230b66fb6ac419bcd776a4cae98a7c9b2fb6bbd0c"}
Jul 03 15:15:55.071896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:55.071821    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.052903663 podStartE2EDuration="2.071796281s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.892618ms" isStatefulPod=false podCreationTimestamp="2026-07-03 15:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:15:55.070121348 +0000 UTC m=+155.544303022" watchObservedRunningTime="2026-07-03 15:15:55.071796281 +0000 UTC m=+155.545977889"
Jul 03 15:15:58.406052 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:15:58.406011    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:16:53.406029 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:16:53.405983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:16:53.422426 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:16:53.422402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:16:54.307389 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:16:54.307329    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 15:18:19.856118 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:19.856083    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:18:19.858916 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:19.858894    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:18:19.859319 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:19.859302    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 03 15:18:28.223450 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.223417    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-925ss"]
Jul 03 15:18:28.226629 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.226614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.229466 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.229437    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 03 15:18:28.229589 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.229510    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 03 15:18:28.230748 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.230728    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lmf87\""
Jul 03 15:18:28.236490 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.236463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-925ss"]
Jul 03 15:18:28.256559 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.256521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f59p\" (UniqueName: \"kubernetes.io/projected/17317477-2870-41a9-9d11-f6e29283d096-kube-api-access-7f59p\") pod \"cert-manager-webhook-6486ffd997-925ss\" (UID: \"17317477-2870-41a9-9d11-f6e29283d096\") " pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.256726 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.256575    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17317477-2870-41a9-9d11-f6e29283d096-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-925ss\" (UID: \"17317477-2870-41a9-9d11-f6e29283d096\") " pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.357245 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.357205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f59p\" (UniqueName: \"kubernetes.io/projected/17317477-2870-41a9-9d11-f6e29283d096-kube-api-access-7f59p\") pod \"cert-manager-webhook-6486ffd997-925ss\" (UID: \"17317477-2870-41a9-9d11-f6e29283d096\") " pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.357456 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.357254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17317477-2870-41a9-9d11-f6e29283d096-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-925ss\" (UID: \"17317477-2870-41a9-9d11-f6e29283d096\") " pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.366845 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.366814    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17317477-2870-41a9-9d11-f6e29283d096-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-925ss\" (UID: \"17317477-2870-41a9-9d11-f6e29283d096\") " pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.366985 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.366968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f59p\" (UniqueName: \"kubernetes.io/projected/17317477-2870-41a9-9d11-f6e29283d096-kube-api-access-7f59p\") pod \"cert-manager-webhook-6486ffd997-925ss\" (UID: \"17317477-2870-41a9-9d11-f6e29283d096\") " pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.548626 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.548542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:28.692566 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.692525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-925ss"]
Jul 03 15:18:28.697850 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:18:28.697825    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17317477_2870_41a9_9d11_f6e29283d096.slice/crio-f71656757f68ba433c5fc48706bcd61c54f11f3f563b92ea977d92544f6808db WatchSource:0}: Error finding container f71656757f68ba433c5fc48706bcd61c54f11f3f563b92ea977d92544f6808db: Status 404 returned error can't find the container with id f71656757f68ba433c5fc48706bcd61c54f11f3f563b92ea977d92544f6808db
Jul 03 15:18:28.700144 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:28.700126    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 15:18:29.677423 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:29.677351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss" event={"ID":"17317477-2870-41a9-9d11-f6e29283d096","Type":"ContainerStarted","Data":"f71656757f68ba433c5fc48706bcd61c54f11f3f563b92ea977d92544f6808db"}
Jul 03 15:18:33.699725 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:33.699691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss" event={"ID":"17317477-2870-41a9-9d11-f6e29283d096","Type":"ContainerStarted","Data":"ae7721ca58bb66be4fbd890d53cebfda51ad9b747e36acac07498435867aa45a"}
Jul 03 15:18:33.700152 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:33.699750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:33.716307 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:33.716253    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss" podStartSLOduration=1.27204049 podStartE2EDuration="5.716232523s" totalImagesPullingTime="4.444192033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:18:33.715586304 +0000 UTC m=+314.189767911" watchObservedRunningTime="2026-07-03 15:18:33.716232523 +0000 UTC m=+314.190414128"
Jul 03 15:18:38.183680 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.183640    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6lplf"]
Jul 03 15:18:38.187341 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.187319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.190113 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.190094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v5mjt\""
Jul 03 15:18:38.196738 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.196683    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6lplf"]
Jul 03 15:18:38.252721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.252685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmm7b\" (UniqueName: \"kubernetes.io/projected/bbbb0ea7-b661-488d-97a6-488cda00c91d-kube-api-access-bmm7b\") pod \"cert-manager-55b4d954d5-6lplf\" (UID: \"bbbb0ea7-b661-488d-97a6-488cda00c91d\") " pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.252905 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.252730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbbb0ea7-b661-488d-97a6-488cda00c91d-bound-sa-token\") pod \"cert-manager-55b4d954d5-6lplf\" (UID: \"bbbb0ea7-b661-488d-97a6-488cda00c91d\") " pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.353509 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.353469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbbb0ea7-b661-488d-97a6-488cda00c91d-bound-sa-token\") pod \"cert-manager-55b4d954d5-6lplf\" (UID: \"bbbb0ea7-b661-488d-97a6-488cda00c91d\") " pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.353681 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.353576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmm7b\" (UniqueName: \"kubernetes.io/projected/bbbb0ea7-b661-488d-97a6-488cda00c91d-kube-api-access-bmm7b\") pod \"cert-manager-55b4d954d5-6lplf\" (UID: \"bbbb0ea7-b661-488d-97a6-488cda00c91d\") " pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.361606 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.361579    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbbb0ea7-b661-488d-97a6-488cda00c91d-bound-sa-token\") pod \"cert-manager-55b4d954d5-6lplf\" (UID: \"bbbb0ea7-b661-488d-97a6-488cda00c91d\") " pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.361763 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.361745    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmm7b\" (UniqueName: \"kubernetes.io/projected/bbbb0ea7-b661-488d-97a6-488cda00c91d-kube-api-access-bmm7b\") pod \"cert-manager-55b4d954d5-6lplf\" (UID: \"bbbb0ea7-b661-488d-97a6-488cda00c91d\") " pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.501131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.501040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6lplf"
Jul 03 15:18:38.637035 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.637008    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6lplf"]
Jul 03 15:18:38.639585 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:18:38.639558    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbbb0ea7_b661_488d_97a6_488cda00c91d.slice/crio-f06fb10f909d71597ecc2f02c499a6eb8933f5332ed587a2e43b8437cc025397 WatchSource:0}: Error finding container f06fb10f909d71597ecc2f02c499a6eb8933f5332ed587a2e43b8437cc025397: Status 404 returned error can't find the container with id f06fb10f909d71597ecc2f02c499a6eb8933f5332ed587a2e43b8437cc025397
Jul 03 15:18:38.721695 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:38.721669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6lplf" event={"ID":"bbbb0ea7-b661-488d-97a6-488cda00c91d","Type":"ContainerStarted","Data":"f06fb10f909d71597ecc2f02c499a6eb8933f5332ed587a2e43b8437cc025397"}
Jul 03 15:18:39.705936 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:39.705900    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-925ss"
Jul 03 15:18:39.730025 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:39.729983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6lplf" event={"ID":"bbbb0ea7-b661-488d-97a6-488cda00c91d","Type":"ContainerStarted","Data":"14165e2d5d6abed9bf7af3bf3d05fe3b0f7edc3a8f6bde0b335d1bf0cbcb593f"}
Jul 03 15:18:39.750110 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:18:39.750053    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6lplf" podStartSLOduration=1.750033761 podStartE2EDuration="1.750033761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:18:39.749076355 +0000 UTC m=+320.223257961" watchObservedRunningTime="2026-07-03 15:18:39.750033761 +0000 UTC m=+320.224215366"
Jul 03 15:19:04.303854 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.303817    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"]
Jul 03 15:19:04.308581 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.308561    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.311497 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.311469    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 03 15:19:04.311620 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.311542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 03 15:19:04.311716 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.311703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 03 15:19:04.313930 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.313908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4hhbk\""
Jul 03 15:19:04.314041 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.314014    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 03 15:19:04.330204 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.330175    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"]
Jul 03 15:19:04.392020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.391977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca559753-2330-4f36-930a-4bd2253712e4-manifests\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.392020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.392023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tkgg\" (UniqueName: \"kubernetes.io/projected/ca559753-2330-4f36-930a-4bd2253712e4-kube-api-access-4tkgg\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.392226 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.392076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca559753-2330-4f36-930a-4bd2253712e4-tmp\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.392226 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.392149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca559753-2330-4f36-930a-4bd2253712e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.392297 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.392225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca559753-2330-4f36-930a-4bd2253712e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.492602 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.492562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca559753-2330-4f36-930a-4bd2253712e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.492602 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.492603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca559753-2330-4f36-930a-4bd2253712e4-manifests\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.492857 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.492628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tkgg\" (UniqueName: \"kubernetes.io/projected/ca559753-2330-4f36-930a-4bd2253712e4-kube-api-access-4tkgg\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.492857 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.492651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca559753-2330-4f36-930a-4bd2253712e4-tmp\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.492857 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.492699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca559753-2330-4f36-930a-4bd2253712e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.493135 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.493113    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca559753-2330-4f36-930a-4bd2253712e4-manifests\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.495215 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.495189    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca559753-2330-4f36-930a-4bd2253712e4-tmp\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.495324 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.495272    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca559753-2330-4f36-930a-4bd2253712e4-webhook-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.495324 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.495302    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca559753-2330-4f36-930a-4bd2253712e4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.507468 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.507448    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tkgg\" (UniqueName: \"kubernetes.io/projected/ca559753-2330-4f36-930a-4bd2253712e4-kube-api-access-4tkgg\") pod \"opendatahub-operator-controller-manager-86b59fc499-j2ggh\" (UID: \"ca559753-2330-4f36-930a-4bd2253712e4\") " pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.618419 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.618387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:04.757599 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.757566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"]
Jul 03 15:19:04.761049 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:19:04.761020    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca559753_2330_4f36_930a_4bd2253712e4.slice/crio-f53543441a6b3720df1b381d7f29ef206607b45f3ef2daa5bf87fc82e335769a WatchSource:0}: Error finding container f53543441a6b3720df1b381d7f29ef206607b45f3ef2daa5bf87fc82e335769a: Status 404 returned error can't find the container with id f53543441a6b3720df1b381d7f29ef206607b45f3ef2daa5bf87fc82e335769a
Jul 03 15:19:04.836800 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:04.836767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh" event={"ID":"ca559753-2330-4f36-930a-4bd2253712e4","Type":"ContainerStarted","Data":"f53543441a6b3720df1b381d7f29ef206607b45f3ef2daa5bf87fc82e335769a"}
Jul 03 15:19:07.855437 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:07.855392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh" event={"ID":"ca559753-2330-4f36-930a-4bd2253712e4","Type":"ContainerStarted","Data":"9bd57327cba3c320684274c4b53625cb632bfc188667e2539ff27a8f27443b44"}
Jul 03 15:19:08.862069 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:08.862036    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca559753-2330-4f36-930a-4bd2253712e4" containerID="9bd57327cba3c320684274c4b53625cb632bfc188667e2539ff27a8f27443b44" exitCode=0
Jul 03 15:19:08.862480 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:08.862128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh" event={"ID":"ca559753-2330-4f36-930a-4bd2253712e4","Type":"ContainerDied","Data":"9bd57327cba3c320684274c4b53625cb632bfc188667e2539ff27a8f27443b44"}
Jul 03 15:19:09.868161 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:09.868123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh" event={"ID":"ca559753-2330-4f36-930a-4bd2253712e4","Type":"ContainerStarted","Data":"17e221112f43fb6228b168f61e788eec287b6bf603374f04570be2d3b956e056"}
Jul 03 15:19:09.868684 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:09.868237    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:09.889543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:09.889491    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh" podStartSLOduration=1.706558521 podStartE2EDuration="5.889474435s" totalImagesPullingTime="3.151606954s" totalInitContainerRuntime="1.03130896s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:09.889237794 +0000 UTC m=+350.363419399" watchObservedRunningTime="2026-07-03 15:19:09.889474435 +0000 UTC m=+350.363656039"
Jul 03 15:19:20.874513 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:20.874428    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86b59fc499-j2ggh"
Jul 03 15:19:30.789323 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.789287    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"]
Jul 03 15:19:30.800810 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.800781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:30.809045 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.809024    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 03 15:19:30.809299 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.809279    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 03 15:19:30.809510 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.809494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 03 15:19:30.810671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.810650    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 03 15:19:30.810772 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.810678    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 03 15:19:30.810772 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.810650    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5fv4h\""
Jul 03 15:19:30.816699 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.816677    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"]
Jul 03 15:19:30.926858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.926819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f96150c6-9c08-4acf-bf3d-242c20c86514-manager-config\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:30.927058 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.926877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96150c6-9c08-4acf-bf3d-242c20c86514-cert\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:30.927058 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.926937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f96150c6-9c08-4acf-bf3d-242c20c86514-metrics-cert\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:30.927058 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:30.927051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5jv\" (UniqueName: \"kubernetes.io/projected/f96150c6-9c08-4acf-bf3d-242c20c86514-kube-api-access-sk5jv\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.027859 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.027820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5jv\" (UniqueName: \"kubernetes.io/projected/f96150c6-9c08-4acf-bf3d-242c20c86514-kube-api-access-sk5jv\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.028067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.027875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f96150c6-9c08-4acf-bf3d-242c20c86514-manager-config\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.028067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.027918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96150c6-9c08-4acf-bf3d-242c20c86514-cert\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.028186 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.028083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f96150c6-9c08-4acf-bf3d-242c20c86514-metrics-cert\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.028746 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.028677    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f96150c6-9c08-4acf-bf3d-242c20c86514-manager-config\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.030619 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.030600    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f96150c6-9c08-4acf-bf3d-242c20c86514-metrics-cert\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.030700 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.030655    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f96150c6-9c08-4acf-bf3d-242c20c86514-cert\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.044054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.043994    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5jv\" (UniqueName: \"kubernetes.io/projected/f96150c6-9c08-4acf-bf3d-242c20c86514-kube-api-access-sk5jv\") pod \"lws-controller-manager-6c796b4fcc-6v5vq\" (UID: \"f96150c6-9c08-4acf-bf3d-242c20c86514\") " pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.111313 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.111280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:31.297623 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.297588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"]
Jul 03 15:19:31.970970 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:31.970189    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq" event={"ID":"f96150c6-9c08-4acf-bf3d-242c20c86514","Type":"ContainerStarted","Data":"0c281b345264c88a0431c92c233bdf3d4d5e1bea25bbc170fefde2bcd55c9d5b"}
Jul 03 15:19:33.352693 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.352656    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"]
Jul 03 15:19:33.360612 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.360581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.366470 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.366396    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 03 15:19:33.366470 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.366463    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 03 15:19:33.366707 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.366531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 03 15:19:33.368163 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.367881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 03 15:19:33.368163 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.367954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 03 15:19:33.368163 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.368107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 03 15:19:33.368163 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.368131    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-54jz8\""
Jul 03 15:19:33.376322 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.376297    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"]
Jul 03 15:19:33.451934 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.451883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.452131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.451974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.452131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.452042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.452131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.452095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.452131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.452130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94102289-8ef7-40d9-b2b3-888f5c33d243-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.452400 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.452255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.452400 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.452283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7brgj\" (UniqueName: \"kubernetes.io/projected/94102289-8ef7-40d9-b2b3-888f5c33d243-kube-api-access-7brgj\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553024 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.552987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.553040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.553065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.553088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.553106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94102289-8ef7-40d9-b2b3-888f5c33d243-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.553132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.553206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.553191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7brgj\" (UniqueName: \"kubernetes.io/projected/94102289-8ef7-40d9-b2b3-888f5c33d243-kube-api-access-7brgj\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.554338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.554306    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.555712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.555683    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.555712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.555693    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/94102289-8ef7-40d9-b2b3-888f5c33d243-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.555869 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.555767    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.555869 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.555849    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.570665 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.570635    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94102289-8ef7-40d9-b2b3-888f5c33d243-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.570927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.570906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7brgj\" (UniqueName: \"kubernetes.io/projected/94102289-8ef7-40d9-b2b3-888f5c33d243-kube-api-access-7brgj\") pod \"istiod-openshift-gateway-94bb8fbfd-qchx6\" (UID: \"94102289-8ef7-40d9-b2b3-888f5c33d243\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:33.675674 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:33.675592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:34.112921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:34.112895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"]
Jul 03 15:19:34.115973 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:19:34.115934    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94102289_8ef7_40d9_b2b3_888f5c33d243.slice/crio-b196f77e5937d2c5b1e01915d2290f963acbc91848887e242df5bfd698a9c11a WatchSource:0}: Error finding container b196f77e5937d2c5b1e01915d2290f963acbc91848887e242df5bfd698a9c11a: Status 404 returned error can't find the container with id b196f77e5937d2c5b1e01915d2290f963acbc91848887e242df5bfd698a9c11a
Jul 03 15:19:34.987598 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:34.987561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq" event={"ID":"f96150c6-9c08-4acf-bf3d-242c20c86514","Type":"ContainerStarted","Data":"4ce6f419bfa404e345e835a7c6d6633249f51d8d6435932adab79648cb5851e8"}
Jul 03 15:19:34.988117 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:34.987634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:34.988892 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:34.988864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6" event={"ID":"94102289-8ef7-40d9-b2b3-888f5c33d243","Type":"ContainerStarted","Data":"b196f77e5937d2c5b1e01915d2290f963acbc91848887e242df5bfd698a9c11a"}
Jul 03 15:19:35.047827 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:35.047758    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq" podStartSLOduration=2.316612872 podStartE2EDuration="5.047737164s" totalImagesPullingTime="2.731124292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:35.047431472 +0000 UTC m=+375.521613077" watchObservedRunningTime="2026-07-03 15:19:35.047737164 +0000 UTC m=+375.521918770"
Jul 03 15:19:44.626376 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:44.626312    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 03 15:19:44.626663 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:44.626410    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 03 15:19:45.042203 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:45.042109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6" event={"ID":"94102289-8ef7-40d9-b2b3-888f5c33d243","Type":"ContainerStarted","Data":"b9e4e3e6ecef9611e4489cf5fb419c9fd0823c8c4e8bc16be56cce17c1ace312"}
Jul 03 15:19:45.042341 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:45.042209    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:19:45.043896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:45.043858    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-qchx6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 03 15:19:45.044028 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:45.043915    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6" podUID="94102289-8ef7-40d9-b2b3-888f5c33d243" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 15:19:45.064580 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:45.064530    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6" podStartSLOduration=1.556616906 podStartE2EDuration="12.064514387s" totalImagesPullingTime="10.507897481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:19:45.06301427 +0000 UTC m=+385.537195876" watchObservedRunningTime="2026-07-03 15:19:45.064514387 +0000 UTC m=+385.538695991"
Jul 03 15:19:45.996930 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:45.996892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c796b4fcc-6v5vq"
Jul 03 15:19:46.047195 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:19:46.047168    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qchx6"
Jul 03 15:21:21.559338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.559300    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"]
Jul 03 15:21:21.562576 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.562560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.565495 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.565474    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 03 15:21:21.565611 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.565493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 03 15:21:21.565611 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.565519    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tdvnd\""
Jul 03 15:21:21.574875 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.574848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"]
Jul 03 15:21:21.649094 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.649063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tfhf\" (UniqueName: \"kubernetes.io/projected/c27a4ad6-48be-46dd-9982-028c91cd25d8-kube-api-access-2tfhf\") pod \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.649280 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.649115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c27a4ad6-48be-46dd-9982-028c91cd25d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.750194 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.750158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tfhf\" (UniqueName: \"kubernetes.io/projected/c27a4ad6-48be-46dd-9982-028c91cd25d8-kube-api-access-2tfhf\") pod \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.750422 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.750226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c27a4ad6-48be-46dd-9982-028c91cd25d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.750620 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.750599    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c27a4ad6-48be-46dd-9982-028c91cd25d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.762720 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.762696    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tfhf\" (UniqueName: \"kubernetes.io/projected/c27a4ad6-48be-46dd-9982-028c91cd25d8-kube-api-access-2tfhf\") pod \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:21.873142 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:21.873105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:22.010516 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:21:22.010479    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27a4ad6_48be_46dd_9982_028c91cd25d8.slice/crio-438c6d76ebc27a0e6e6d449c9af6bab26df1eb6248a8f1ab7fdd3d6ca2288ae3 WatchSource:0}: Error finding container 438c6d76ebc27a0e6e6d449c9af6bab26df1eb6248a8f1ab7fdd3d6ca2288ae3: Status 404 returned error can't find the container with id 438c6d76ebc27a0e6e6d449c9af6bab26df1eb6248a8f1ab7fdd3d6ca2288ae3
Jul 03 15:21:22.011517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.011493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"]
Jul 03 15:21:22.026221 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.026181    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"]
Jul 03 15:21:22.031033 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.031010    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"]
Jul 03 15:21:22.050126 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.050090    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"]
Jul 03 15:21:22.054638 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.054617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.069550 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.069522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"]
Jul 03 15:21:22.152310 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.152218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6bpt\" (UniqueName: \"kubernetes.io/projected/0ef58d69-21e2-48ec-8508-0b8a12c52890-kube-api-access-g6bpt\") pod \"kuadrant-operator-controller-manager-55467d9f7-mmv7j\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.152475 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.152382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ef58d69-21e2-48ec-8508-0b8a12c52890-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mmv7j\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.253481 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.253445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ef58d69-21e2-48ec-8508-0b8a12c52890-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mmv7j\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.253676 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.253512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6bpt\" (UniqueName: \"kubernetes.io/projected/0ef58d69-21e2-48ec-8508-0b8a12c52890-kube-api-access-g6bpt\") pod \"kuadrant-operator-controller-manager-55467d9f7-mmv7j\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.253864 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.253841    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ef58d69-21e2-48ec-8508-0b8a12c52890-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mmv7j\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.266034 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.266002    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6bpt\" (UniqueName: \"kubernetes.io/projected/0ef58d69-21e2-48ec-8508-0b8a12c52890-kube-api-access-g6bpt\") pod \"kuadrant-operator-controller-manager-55467d9f7-mmv7j\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.365603 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.365552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:22.506774 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:22.506747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"]
Jul 03 15:21:22.507804 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:21:22.507778    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef58d69_21e2_48ec_8508_0b8a12c52890.slice/crio-b364d56987671914e578b487619e952f00982e9057d0de89b3cf7b4716771bd6 WatchSource:0}: Error finding container b364d56987671914e578b487619e952f00982e9057d0de89b3cf7b4716771bd6: Status 404 returned error can't find the container with id b364d56987671914e578b487619e952f00982e9057d0de89b3cf7b4716771bd6
Jul 03 15:21:23.500061 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:23.500001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j" event={"ID":"0ef58d69-21e2-48ec-8508-0b8a12c52890","Type":"ContainerStarted","Data":"b364d56987671914e578b487619e952f00982e9057d0de89b3cf7b4716771bd6"}
Jul 03 15:21:27.525128 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.525056    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" containerName="manager" containerID="cri-o://d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175" gracePeriod=2
Jul 03 15:21:27.526491 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.526462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j" event={"ID":"0ef58d69-21e2-48ec-8508-0b8a12c52890","Type":"ContainerStarted","Data":"d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f"}
Jul 03 15:21:27.526620 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.526592    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:27.549131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.549084    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j" podStartSLOduration=1.251219354 podStartE2EDuration="5.549067259s" totalImagesPullingTime="4.297847905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:21:27.548763615 +0000 UTC m=+488.022945235" watchObservedRunningTime="2026-07-03 15:21:27.549067259 +0000 UTC m=+488.023248865"
Jul 03 15:21:27.763721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.763695    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:27.766185 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:21:27.766152    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" is forbidden: User \"system:node:ip-10-0-138-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-243.ec2.internal' and this object" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:27.800790 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.800717    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c27a4ad6-48be-46dd-9982-028c91cd25d8-extensions-socket-volume\") pod \"c27a4ad6-48be-46dd-9982-028c91cd25d8\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") "
Jul 03 15:21:27.800790 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.800768    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tfhf\" (UniqueName: \"kubernetes.io/projected/c27a4ad6-48be-46dd-9982-028c91cd25d8-kube-api-access-2tfhf\") pod \"c27a4ad6-48be-46dd-9982-028c91cd25d8\" (UID: \"c27a4ad6-48be-46dd-9982-028c91cd25d8\") "
Jul 03 15:21:27.800995 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.800966    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c27a4ad6-48be-46dd-9982-028c91cd25d8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c27a4ad6-48be-46dd-9982-028c91cd25d8" (UID: "c27a4ad6-48be-46dd-9982-028c91cd25d8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 15:21:27.803068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.803046    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27a4ad6-48be-46dd-9982-028c91cd25d8-kube-api-access-2tfhf" (OuterVolumeSpecName: "kube-api-access-2tfhf") pod "c27a4ad6-48be-46dd-9982-028c91cd25d8" (UID: "c27a4ad6-48be-46dd-9982-028c91cd25d8"). InnerVolumeSpecName "kube-api-access-2tfhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:21:27.901338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.901303    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c27a4ad6-48be-46dd-9982-028c91cd25d8-extensions-socket-volume\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:21:27.901338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:27.901333    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tfhf\" (UniqueName: \"kubernetes.io/projected/c27a4ad6-48be-46dd-9982-028c91cd25d8-kube-api-access-2tfhf\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:21:28.010071 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:28.010040    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" path="/var/lib/kubelet/pods/c27a4ad6-48be-46dd-9982-028c91cd25d8/volumes"
Jul 03 15:21:28.532667 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:28.532628    2579 generic.go:356] "Generic (PLEG): container finished" podID="c27a4ad6-48be-46dd-9982-028c91cd25d8" containerID="d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175" exitCode=2
Jul 03 15:21:28.533079 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:28.532677    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:28.533079 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:28.532726    2579 scope.go:117] "RemoveContainer" containerID="d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175"
Jul 03 15:21:28.537666 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:21:28.537637    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" is forbidden: User \"system:node:ip-10-0-138-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-243.ec2.internal' and this object" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:28.541163 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:28.541148    2579 scope.go:117] "RemoveContainer" containerID="d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175"
Jul 03 15:21:28.541432 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:21:28.541413    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175\": container with ID starting with d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175 not found: ID does not exist" containerID="d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175"
Jul 03 15:21:28.541498 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:28.541439    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175"} err="failed to get container status \"d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175\": rpc error: code = NotFound desc = could not find container \"d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175\": container with ID starting with d74b9ef4a6ef9c2c76f8262617ff38abdf405eb53483eddf6451a46f8340d175 not found: ID does not exist"
Jul 03 15:21:30.010007 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:21:30.009970    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-2vgbt\" is forbidden: User \"system:node:ip-10-0-138-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-243.ec2.internal' and this object" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-2vgbt"
Jul 03 15:21:38.534858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:38.534825    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:51.528069 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.528027    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"]
Jul 03 15:21:51.528549 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.528336    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j" podUID="0ef58d69-21e2-48ec-8508-0b8a12c52890" containerName="manager" containerID="cri-o://d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f" gracePeriod=10
Jul 03 15:21:51.781566 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.781508    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:51.918101 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.918067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6bpt\" (UniqueName: \"kubernetes.io/projected/0ef58d69-21e2-48ec-8508-0b8a12c52890-kube-api-access-g6bpt\") pod \"0ef58d69-21e2-48ec-8508-0b8a12c52890\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") "
Jul 03 15:21:51.918101 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.918106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ef58d69-21e2-48ec-8508-0b8a12c52890-extensions-socket-volume\") pod \"0ef58d69-21e2-48ec-8508-0b8a12c52890\" (UID: \"0ef58d69-21e2-48ec-8508-0b8a12c52890\") "
Jul 03 15:21:51.918618 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.918592    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef58d69-21e2-48ec-8508-0b8a12c52890-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ef58d69-21e2-48ec-8508-0b8a12c52890" (UID: "0ef58d69-21e2-48ec-8508-0b8a12c52890"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 15:21:51.920253 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:51.920234    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef58d69-21e2-48ec-8508-0b8a12c52890-kube-api-access-g6bpt" (OuterVolumeSpecName: "kube-api-access-g6bpt") pod "0ef58d69-21e2-48ec-8508-0b8a12c52890" (UID: "0ef58d69-21e2-48ec-8508-0b8a12c52890"). InnerVolumeSpecName "kube-api-access-g6bpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:21:52.019508 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.019483    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6bpt\" (UniqueName: \"kubernetes.io/projected/0ef58d69-21e2-48ec-8508-0b8a12c52890-kube-api-access-g6bpt\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:21:52.019508 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.019508    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ef58d69-21e2-48ec-8508-0b8a12c52890-extensions-socket-volume\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:21:52.644046 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.644008    2579 generic.go:356] "Generic (PLEG): container finished" podID="0ef58d69-21e2-48ec-8508-0b8a12c52890" containerID="d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f" exitCode=0
Jul 03 15:21:52.644511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.644051    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"
Jul 03 15:21:52.644511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.644094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j" event={"ID":"0ef58d69-21e2-48ec-8508-0b8a12c52890","Type":"ContainerDied","Data":"d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f"}
Jul 03 15:21:52.644511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.644147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j" event={"ID":"0ef58d69-21e2-48ec-8508-0b8a12c52890","Type":"ContainerDied","Data":"b364d56987671914e578b487619e952f00982e9057d0de89b3cf7b4716771bd6"}
Jul 03 15:21:52.644511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.644170    2579 scope.go:117] "RemoveContainer" containerID="d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f"
Jul 03 15:21:52.652916 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.652900    2579 scope.go:117] "RemoveContainer" containerID="d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f"
Jul 03 15:21:52.653215 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:21:52.653198    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f\": container with ID starting with d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f not found: ID does not exist" containerID="d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f"
Jul 03 15:21:52.653276 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.653224    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f"} err="failed to get container status \"d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f\": rpc error: code = NotFound desc = could not find container \"d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f\": container with ID starting with d5703e15c4187950de630a47972db3948319efd482205cce938784ba9bc7b83f not found: ID does not exist"
Jul 03 15:21:52.664316 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.664295    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"]
Jul 03 15:21:52.670348 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:52.670319    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mmv7j"]
Jul 03 15:21:54.009626 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:21:54.009594    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ef58d69-21e2-48ec-8508-0b8a12c52890" path="/var/lib/kubelet/pods/0ef58d69-21e2-48ec-8508-0b8a12c52890/volumes"
Jul 03 15:22:13.508643 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.508560    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:13.509054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.508918    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" containerName="manager"
Jul 03 15:22:13.509054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.508929    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" containerName="manager"
Jul 03 15:22:13.509054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.508936    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ef58d69-21e2-48ec-8508-0b8a12c52890" containerName="manager"
Jul 03 15:22:13.509054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.508941    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef58d69-21e2-48ec-8508-0b8a12c52890" containerName="manager"
Jul 03 15:22:13.509054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.509001    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27a4ad6-48be-46dd-9982-028c91cd25d8" containerName="manager"
Jul 03 15:22:13.509054 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.509009    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ef58d69-21e2-48ec-8508-0b8a12c52890" containerName="manager"
Jul 03 15:22:13.511522 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.511503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.514375 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.514337    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 03 15:22:13.514375 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.514354    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 03 15:22:13.515570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.515551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 03 15:22:13.515570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.515560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dp9v2\""
Jul 03 15:22:13.518776 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.518748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mnq\" (UniqueName: \"kubernetes.io/projected/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-kube-api-access-z8mnq\") pod \"limitador-limitador-64c94fd64f-wvns2\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.518899 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.518799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-config-file\") pod \"limitador-limitador-64c94fd64f-wvns2\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.519860 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.519840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:13.604297 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.604260    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:13.619755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.619722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mnq\" (UniqueName: \"kubernetes.io/projected/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-kube-api-access-z8mnq\") pod \"limitador-limitador-64c94fd64f-wvns2\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.619927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.619777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-config-file\") pod \"limitador-limitador-64c94fd64f-wvns2\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.620491 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.620467    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-config-file\") pod \"limitador-limitador-64c94fd64f-wvns2\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.628479 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.628456    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mnq\" (UniqueName: \"kubernetes.io/projected/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-kube-api-access-z8mnq\") pod \"limitador-limitador-64c94fd64f-wvns2\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.822215 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.822130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:13.955854 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:13.955830    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:13.958263 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:22:13.958228    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a92f3dd_2e77_4b76_9a85_4c096de3a5b9.slice/crio-db406bf7ec09324a6d320aaf605434f1ae37a564508e26679a46269cb2f74605 WatchSource:0}: Error finding container db406bf7ec09324a6d320aaf605434f1ae37a564508e26679a46269cb2f74605: Status 404 returned error can't find the container with id db406bf7ec09324a6d320aaf605434f1ae37a564508e26679a46269cb2f74605
Jul 03 15:22:14.752955 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:14.752914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2" event={"ID":"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9","Type":"ContainerStarted","Data":"db406bf7ec09324a6d320aaf605434f1ae37a564508e26679a46269cb2f74605"}
Jul 03 15:22:16.764155 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:16.764123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2" event={"ID":"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9","Type":"ContainerStarted","Data":"fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124"}
Jul 03 15:22:16.764516 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:16.764208    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:16.781439 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:16.781384    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2" podStartSLOduration=1.05055805 podStartE2EDuration="3.781348444s" totalImagesPullingTime="2.730790394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:22:16.779897755 +0000 UTC m=+537.254079360" watchObservedRunningTime="2026-07-03 15:22:16.781348444 +0000 UTC m=+537.255530046"
Jul 03 15:22:27.770638 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:27.770605    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:28.733648 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:28.733613    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:28.733856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:28.733828    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2" podUID="9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" containerName="limitador" containerID="cri-o://fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124" gracePeriod=30
Jul 03 15:22:29.280962 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.280939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:29.372198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.372164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8mnq\" (UniqueName: \"kubernetes.io/projected/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-kube-api-access-z8mnq\") pod \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") "
Jul 03 15:22:29.372420 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.372215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-config-file\") pod \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\" (UID: \"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9\") "
Jul 03 15:22:29.372618 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.372593    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-config-file" (OuterVolumeSpecName: "config-file") pod "9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" (UID: "9a92f3dd-2e77-4b76-9a85-4c096de3a5b9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:22:29.374325 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.374303    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-kube-api-access-z8mnq" (OuterVolumeSpecName: "kube-api-access-z8mnq") pod "9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" (UID: "9a92f3dd-2e77-4b76-9a85-4c096de3a5b9"). InnerVolumeSpecName "kube-api-access-z8mnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:22:29.473148 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.473109    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8mnq\" (UniqueName: \"kubernetes.io/projected/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-kube-api-access-z8mnq\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:22:29.473148 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.473141    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9-config-file\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:22:29.823001 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.822913    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" containerID="fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124" exitCode=0
Jul 03 15:22:29.823001 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.822963    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2"
Jul 03 15:22:29.823289 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.822998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2" event={"ID":"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9","Type":"ContainerDied","Data":"fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124"}
Jul 03 15:22:29.823289 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.823054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wvns2" event={"ID":"9a92f3dd-2e77-4b76-9a85-4c096de3a5b9","Type":"ContainerDied","Data":"db406bf7ec09324a6d320aaf605434f1ae37a564508e26679a46269cb2f74605"}
Jul 03 15:22:29.823289 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.823080    2579 scope.go:117] "RemoveContainer" containerID="fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124"
Jul 03 15:22:29.832024 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.832009    2579 scope.go:117] "RemoveContainer" containerID="fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124"
Jul 03 15:22:29.832333 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:22:29.832315    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124\": container with ID starting with fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124 not found: ID does not exist" containerID="fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124"
Jul 03 15:22:29.832422 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.832343    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124"} err="failed to get container status \"fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124\": rpc error: code = NotFound desc = could not find container \"fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124\": container with ID starting with fae82e559b152fbe2253dcd5eea18b221d27bf69911b4d1f3a4e3b9eb0074124 not found: ID does not exist"
Jul 03 15:22:29.845328 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.845299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:29.848787 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:29.848764    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wvns2"]
Jul 03 15:22:30.009941 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:30.009905    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" path="/var/lib/kubelet/pods/9a92f3dd-2e77-4b76-9a85-4c096de3a5b9/volumes"
Jul 03 15:22:31.515397 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.515343    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lc8vr"]
Jul 03 15:22:31.516444 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.516415    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" containerName="limitador"
Jul 03 15:22:31.516444 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.516443    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" containerName="limitador"
Jul 03 15:22:31.516593 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.516550    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a92f3dd-2e77-4b76-9a85-4c096de3a5b9" containerName="limitador"
Jul 03 15:22:31.521029 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.521008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.524802 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.524767    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 03 15:22:31.525335 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.525225    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8xh6j\""
Jul 03 15:22:31.526926 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.526862    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lc8vr"]
Jul 03 15:22:31.593385 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.593326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtp7\" (UniqueName: \"kubernetes.io/projected/ee6948ff-5cfc-44f3-87ab-585c41b64509-kube-api-access-9dtp7\") pod \"postgres-69fb4594cf-lc8vr\" (UID: \"ee6948ff-5cfc-44f3-87ab-585c41b64509\") " pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.593557 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.593505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ee6948ff-5cfc-44f3-87ab-585c41b64509-data\") pod \"postgres-69fb4594cf-lc8vr\" (UID: \"ee6948ff-5cfc-44f3-87ab-585c41b64509\") " pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.694667 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.694631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ee6948ff-5cfc-44f3-87ab-585c41b64509-data\") pod \"postgres-69fb4594cf-lc8vr\" (UID: \"ee6948ff-5cfc-44f3-87ab-585c41b64509\") " pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.694835 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.694691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtp7\" (UniqueName: \"kubernetes.io/projected/ee6948ff-5cfc-44f3-87ab-585c41b64509-kube-api-access-9dtp7\") pod \"postgres-69fb4594cf-lc8vr\" (UID: \"ee6948ff-5cfc-44f3-87ab-585c41b64509\") " pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.695008 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.694987    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ee6948ff-5cfc-44f3-87ab-585c41b64509-data\") pod \"postgres-69fb4594cf-lc8vr\" (UID: \"ee6948ff-5cfc-44f3-87ab-585c41b64509\") " pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.703680 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.703657    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtp7\" (UniqueName: \"kubernetes.io/projected/ee6948ff-5cfc-44f3-87ab-585c41b64509-kube-api-access-9dtp7\") pod \"postgres-69fb4594cf-lc8vr\" (UID: \"ee6948ff-5cfc-44f3-87ab-585c41b64509\") " pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.834615 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.834535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:31.980968 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:31.980936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lc8vr"]
Jul 03 15:22:31.984892 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:22:31.984862    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6948ff_5cfc_44f3_87ab_585c41b64509.slice/crio-7d24aadee72fde2c97630182cd508f9843141f8801db4bf18fbce1427e2b24c5 WatchSource:0}: Error finding container 7d24aadee72fde2c97630182cd508f9843141f8801db4bf18fbce1427e2b24c5: Status 404 returned error can't find the container with id 7d24aadee72fde2c97630182cd508f9843141f8801db4bf18fbce1427e2b24c5
Jul 03 15:22:32.838492 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:32.838458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lc8vr" event={"ID":"ee6948ff-5cfc-44f3-87ab-585c41b64509","Type":"ContainerStarted","Data":"7d24aadee72fde2c97630182cd508f9843141f8801db4bf18fbce1427e2b24c5"}
Jul 03 15:22:37.869131 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:37.869094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lc8vr" event={"ID":"ee6948ff-5cfc-44f3-87ab-585c41b64509","Type":"ContainerStarted","Data":"e5106cde1573bda92d560389f7967e8e7bf107fae073df5b0cf28fef7a8d5f5f"}
Jul 03 15:22:37.869520 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:37.869186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:37.887098 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:37.887045    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lc8vr" podStartSLOduration=1.573838776 podStartE2EDuration="6.887029386s" totalImagesPullingTime="5.31319061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:22:37.886293418 +0000 UTC m=+558.360475022" watchObservedRunningTime="2026-07-03 15:22:37.887029386 +0000 UTC m=+558.361210990"
Jul 03 15:22:43.903192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:43.903162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lc8vr"
Jul 03 15:22:53.263378 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.263337    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85c4bbfdc-2kgsv"]
Jul 03 15:22:53.289822 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.289785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c4bbfdc-2kgsv"]
Jul 03 15:22:53.289979 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.289883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.293030 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.293008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 03 15:22:53.293182 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.293076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qpz5c\""
Jul 03 15:22:53.293182 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.293113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 03 15:22:53.385248 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.385212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.385421 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.385257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmsr\" (UniqueName: \"kubernetes.io/projected/81dc5655-ff52-49b6-93be-da8363c74b2e-kube-api-access-jtmsr\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.451245 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.451209    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7767ddc58d-mp6x7"]
Jul 03 15:22:53.454852 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.454830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.467761 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.467736    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-mp6x7"]
Jul 03 15:22:53.486652 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.486278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.486652 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.486336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmsr\" (UniqueName: \"kubernetes.io/projected/81dc5655-ff52-49b6-93be-da8363c74b2e-kube-api-access-jtmsr\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.486652 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:22:53.486471    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 03 15:22:53.486652 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:22:53.486553    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert podName:81dc5655-ff52-49b6-93be-da8363c74b2e nodeName:}" failed. No retries permitted until 2026-07-03 15:22:53.98651747 +0000 UTC m=+574.460699056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert") pod "maas-controller-85c4bbfdc-2kgsv" (UID: "81dc5655-ff52-49b6-93be-da8363c74b2e") : secret "maas-controller-webhook-cert" not found
Jul 03 15:22:53.495957 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.495929    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmsr\" (UniqueName: \"kubernetes.io/projected/81dc5655-ff52-49b6-93be-da8363c74b2e-kube-api-access-jtmsr\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.588001 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.587896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/babef3a1-028c-4ae6-b830-b33b4cd456f6-webhook-cert\") pod \"maas-controller-7767ddc58d-mp6x7\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") " pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.588001 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.587948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkws\" (UniqueName: \"kubernetes.io/projected/babef3a1-028c-4ae6-b830-b33b4cd456f6-kube-api-access-skkws\") pod \"maas-controller-7767ddc58d-mp6x7\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") " pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.689693 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.689649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/babef3a1-028c-4ae6-b830-b33b4cd456f6-webhook-cert\") pod \"maas-controller-7767ddc58d-mp6x7\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") " pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.689887 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.689707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkws\" (UniqueName: \"kubernetes.io/projected/babef3a1-028c-4ae6-b830-b33b4cd456f6-kube-api-access-skkws\") pod \"maas-controller-7767ddc58d-mp6x7\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") " pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.692251 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.692227    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/babef3a1-028c-4ae6-b830-b33b4cd456f6-webhook-cert\") pod \"maas-controller-7767ddc58d-mp6x7\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") " pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.700040 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.700016    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkws\" (UniqueName: \"kubernetes.io/projected/babef3a1-028c-4ae6-b830-b33b4cd456f6-kube-api-access-skkws\") pod \"maas-controller-7767ddc58d-mp6x7\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") " pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.765010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.764973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:53.901211 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.901188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-mp6x7"]
Jul 03 15:22:53.903491 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:22:53.903464    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbabef3a1_028c_4ae6_b830_b33b4cd456f6.slice/crio-4309bed07ee7d11abd781b62f75712619921e855f3880b4c43f82dfe9077e65a WatchSource:0}: Error finding container 4309bed07ee7d11abd781b62f75712619921e855f3880b4c43f82dfe9077e65a: Status 404 returned error can't find the container with id 4309bed07ee7d11abd781b62f75712619921e855f3880b4c43f82dfe9077e65a
Jul 03 15:22:53.943736 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.943704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767ddc58d-mp6x7" event={"ID":"babef3a1-028c-4ae6-b830-b33b4cd456f6","Type":"ContainerStarted","Data":"4309bed07ee7d11abd781b62f75712619921e855f3880b4c43f82dfe9077e65a"}
Jul 03 15:22:53.992104 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.992062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:53.994557 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:53.994538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert\") pod \"maas-controller-85c4bbfdc-2kgsv\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") " pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:54.200867 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:54.200772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:54.336324 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:54.336289    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85c4bbfdc-2kgsv"]
Jul 03 15:22:54.338537 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:22:54.338508    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dc5655_ff52_49b6_93be_da8363c74b2e.slice/crio-520778d36746936f3b85981f97ee791694a3a5c119580bdfb040d00d0e472855 WatchSource:0}: Error finding container 520778d36746936f3b85981f97ee791694a3a5c119580bdfb040d00d0e472855: Status 404 returned error can't find the container with id 520778d36746936f3b85981f97ee791694a3a5c119580bdfb040d00d0e472855
Jul 03 15:22:54.952907 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:54.952859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv" event={"ID":"81dc5655-ff52-49b6-93be-da8363c74b2e","Type":"ContainerStarted","Data":"520778d36746936f3b85981f97ee791694a3a5c119580bdfb040d00d0e472855"}
Jul 03 15:22:56.964976 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:56.964914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767ddc58d-mp6x7" event={"ID":"babef3a1-028c-4ae6-b830-b33b4cd456f6","Type":"ContainerStarted","Data":"d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270"}
Jul 03 15:22:56.965440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:56.964999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:22:56.966313 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:56.966290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv" event={"ID":"81dc5655-ff52-49b6-93be-da8363c74b2e","Type":"ContainerStarted","Data":"93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f"}
Jul 03 15:22:56.966436 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:56.966397    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:22:56.987336 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:56.987293    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7767ddc58d-mp6x7" podStartSLOduration=1.900810308 podStartE2EDuration="3.987278217s" totalImagesPullingTime="2.086467909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:22:56.986497977 +0000 UTC m=+577.460679583" watchObservedRunningTime="2026-07-03 15:22:56.987278217 +0000 UTC m=+577.461459820"
Jul 03 15:22:57.006980 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:22:57.006934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv" podStartSLOduration=2.3445377130000002 podStartE2EDuration="4.006918626s" totalImagesPullingTime="1.662380913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:22:57.005458925 +0000 UTC m=+577.479640529" watchObservedRunningTime="2026-07-03 15:22:57.006918626 +0000 UTC m=+577.481100229"
Jul 03 15:23:07.976837 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:07.976801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:23:07.977245 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:07.976887    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:23:08.039500 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.039463    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c4bbfdc-2kgsv"]
Jul 03 15:23:08.039694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.039662    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv" podUID="81dc5655-ff52-49b6-93be-da8363c74b2e" containerName="manager" containerID="cri-o://93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f" gracePeriod=30
Jul 03 15:23:08.289705 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.289679    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:23:08.320402 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.320354    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtmsr\" (UniqueName: \"kubernetes.io/projected/81dc5655-ff52-49b6-93be-da8363c74b2e-kube-api-access-jtmsr\") pod \"81dc5655-ff52-49b6-93be-da8363c74b2e\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") "
Jul 03 15:23:08.320525 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.320428    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert\") pod \"81dc5655-ff52-49b6-93be-da8363c74b2e\" (UID: \"81dc5655-ff52-49b6-93be-da8363c74b2e\") "
Jul 03 15:23:08.322523 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.322495    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81dc5655-ff52-49b6-93be-da8363c74b2e-kube-api-access-jtmsr" (OuterVolumeSpecName: "kube-api-access-jtmsr") pod "81dc5655-ff52-49b6-93be-da8363c74b2e" (UID: "81dc5655-ff52-49b6-93be-da8363c74b2e"). InnerVolumeSpecName "kube-api-access-jtmsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:23:08.322627 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.322526    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "81dc5655-ff52-49b6-93be-da8363c74b2e" (UID: "81dc5655-ff52-49b6-93be-da8363c74b2e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:23:08.421517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.421481    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtmsr\" (UniqueName: \"kubernetes.io/projected/81dc5655-ff52-49b6-93be-da8363c74b2e-kube-api-access-jtmsr\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:23:08.421517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:08.421516    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81dc5655-ff52-49b6-93be-da8363c74b2e-webhook-cert\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:23:09.024639 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.024604    2579 generic.go:356] "Generic (PLEG): container finished" podID="81dc5655-ff52-49b6-93be-da8363c74b2e" containerID="93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f" exitCode=0
Jul 03 15:23:09.024639 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.024643    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv"
Jul 03 15:23:09.025182 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.024683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv" event={"ID":"81dc5655-ff52-49b6-93be-da8363c74b2e","Type":"ContainerDied","Data":"93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f"}
Jul 03 15:23:09.025182 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.024764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85c4bbfdc-2kgsv" event={"ID":"81dc5655-ff52-49b6-93be-da8363c74b2e","Type":"ContainerDied","Data":"520778d36746936f3b85981f97ee791694a3a5c119580bdfb040d00d0e472855"}
Jul 03 15:23:09.025182 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.024790    2579 scope.go:117] "RemoveContainer" containerID="93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f"
Jul 03 15:23:09.034966 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.034939    2579 scope.go:117] "RemoveContainer" containerID="93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f"
Jul 03 15:23:09.035247 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:23:09.035226    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f\": container with ID starting with 93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f not found: ID does not exist" containerID="93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f"
Jul 03 15:23:09.035299 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.035258    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f"} err="failed to get container status \"93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f\": rpc error: code = NotFound desc = could not find container \"93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f\": container with ID starting with 93179072a19b47e586db1a4105a998cb152137b5595df7b5b094ab68bc6de44f not found: ID does not exist"
Jul 03 15:23:09.046073 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.046046    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85c4bbfdc-2kgsv"]
Jul 03 15:23:09.049954 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:09.049933    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85c4bbfdc-2kgsv"]
Jul 03 15:23:10.010678 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:10.010646    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81dc5655-ff52-49b6-93be-da8363c74b2e" path="/var/lib/kubelet/pods/81dc5655-ff52-49b6-93be-da8363c74b2e/volumes"
Jul 03 15:23:19.888580 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:19.888553    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:23:19.889306 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:19.889282    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:23:29.234294 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.234262    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8755677bc-b89qj"]
Jul 03 15:23:29.236557 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.234641    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81dc5655-ff52-49b6-93be-da8363c74b2e" containerName="manager"
Jul 03 15:23:29.236557 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.234654    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="81dc5655-ff52-49b6-93be-da8363c74b2e" containerName="manager"
Jul 03 15:23:29.236557 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.234754    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="81dc5655-ff52-49b6-93be-da8363c74b2e" containerName="manager"
Jul 03 15:23:29.237606 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.237590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.240560 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.240536    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pjvct\""
Jul 03 15:23:29.240671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.240560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 03 15:23:29.248850 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.248829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8755677bc-b89qj"]
Jul 03 15:23:29.304731 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.304693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b38226-3fe3-4508-9ea4-48ffcec006f0-maas-api-tls\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.304923 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.304746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfjwh\" (UniqueName: \"kubernetes.io/projected/f4b38226-3fe3-4508-9ea4-48ffcec006f0-kube-api-access-nfjwh\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.304923 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.304894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b38226-3fe3-4508-9ea4-48ffcec006f0-openshift-service-ca\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.405535 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.405498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b38226-3fe3-4508-9ea4-48ffcec006f0-maas-api-tls\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.405535 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.405536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfjwh\" (UniqueName: \"kubernetes.io/projected/f4b38226-3fe3-4508-9ea4-48ffcec006f0-kube-api-access-nfjwh\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.405787 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.405594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b38226-3fe3-4508-9ea4-48ffcec006f0-openshift-service-ca\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.405787 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:23:29.405652    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 03 15:23:29.405787 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:23:29.405721    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b38226-3fe3-4508-9ea4-48ffcec006f0-maas-api-tls podName:f4b38226-3fe3-4508-9ea4-48ffcec006f0 nodeName:}" failed. No retries permitted until 2026-07-03 15:23:29.905704839 +0000 UTC m=+610.379886422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4b38226-3fe3-4508-9ea4-48ffcec006f0-maas-api-tls") pod "maas-api-8755677bc-b89qj" (UID: "f4b38226-3fe3-4508-9ea4-48ffcec006f0") : secret "maas-api-serving-cert" not found
Jul 03 15:23:29.406269 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.406251    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b38226-3fe3-4508-9ea4-48ffcec006f0-openshift-service-ca\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.415031 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.415005    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfjwh\" (UniqueName: \"kubernetes.io/projected/f4b38226-3fe3-4508-9ea4-48ffcec006f0-kube-api-access-nfjwh\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.764733 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.764687    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6vwr7"]
Jul 03 15:23:29.769774 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.769748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:29.773263 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.773233    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 03 15:23:29.773600 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.773577    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-w48k2\""
Jul 03 15:23:29.785381 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.785338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6vwr7"]
Jul 03 15:23:29.794561 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.794540    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-k7wm5"]
Jul 03 15:23:29.798661 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.798613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:29.812161 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.811413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-k7wm5"]
Jul 03 15:23:29.910543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.910504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b38226-3fe3-4508-9ea4-48ffcec006f0-maas-api-tls\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:29.910701 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.910556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5npq\" (UniqueName: \"kubernetes.io/projected/4cdb1ed8-1236-47ad-a4e2-c35ae395abc0-kube-api-access-g5npq\") pod \"payload-processing-58f86c7798-6vwr7\" (UID: \"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0\") " pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:29.910701 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.910579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mddf\" (UniqueName: \"kubernetes.io/projected/915f7837-74eb-4459-86a3-30343cce1762-kube-api-access-7mddf\") pod \"payload-pre-processing-7964457696-k7wm5\" (UID: \"915f7837-74eb-4459-86a3-30343cce1762\") " pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:29.910701 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.910637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/915f7837-74eb-4459-86a3-30343cce1762-plugins-config-volume\") pod \"payload-pre-processing-7964457696-k7wm5\" (UID: \"915f7837-74eb-4459-86a3-30343cce1762\") " pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:29.910910 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.910800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdb1ed8-1236-47ad-a4e2-c35ae395abc0-plugins-config-volume\") pod \"payload-processing-58f86c7798-6vwr7\" (UID: \"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0\") " pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:29.913061 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:29.913039    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4b38226-3fe3-4508-9ea4-48ffcec006f0-maas-api-tls\") pod \"maas-api-8755677bc-b89qj\" (UID: \"f4b38226-3fe3-4508-9ea4-48ffcec006f0\") " pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:30.011985 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.011950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/915f7837-74eb-4459-86a3-30343cce1762-plugins-config-volume\") pod \"payload-pre-processing-7964457696-k7wm5\" (UID: \"915f7837-74eb-4459-86a3-30343cce1762\") " pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:30.012150 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.012058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdb1ed8-1236-47ad-a4e2-c35ae395abc0-plugins-config-volume\") pod \"payload-processing-58f86c7798-6vwr7\" (UID: \"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0\") " pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:30.012150 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.012085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5npq\" (UniqueName: \"kubernetes.io/projected/4cdb1ed8-1236-47ad-a4e2-c35ae395abc0-kube-api-access-g5npq\") pod \"payload-processing-58f86c7798-6vwr7\" (UID: \"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0\") " pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:30.012150 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.012101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mddf\" (UniqueName: \"kubernetes.io/projected/915f7837-74eb-4459-86a3-30343cce1762-kube-api-access-7mddf\") pod \"payload-pre-processing-7964457696-k7wm5\" (UID: \"915f7837-74eb-4459-86a3-30343cce1762\") " pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:30.012899 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.012875    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/915f7837-74eb-4459-86a3-30343cce1762-plugins-config-volume\") pod \"payload-pre-processing-7964457696-k7wm5\" (UID: \"915f7837-74eb-4459-86a3-30343cce1762\") " pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:30.012943 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.012875    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cdb1ed8-1236-47ad-a4e2-c35ae395abc0-plugins-config-volume\") pod \"payload-processing-58f86c7798-6vwr7\" (UID: \"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0\") " pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:30.020612 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.020551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5npq\" (UniqueName: \"kubernetes.io/projected/4cdb1ed8-1236-47ad-a4e2-c35ae395abc0-kube-api-access-g5npq\") pod \"payload-processing-58f86c7798-6vwr7\" (UID: \"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0\") " pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:30.020715 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.020645    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mddf\" (UniqueName: \"kubernetes.io/projected/915f7837-74eb-4459-86a3-30343cce1762-kube-api-access-7mddf\") pod \"payload-pre-processing-7964457696-k7wm5\" (UID: \"915f7837-74eb-4459-86a3-30343cce1762\") " pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:30.082209 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.082177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:30.111968 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.111941    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:30.148978 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.148823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:30.242603 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.242571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6vwr7"]
Jul 03 15:23:30.244939 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:23:30.244907    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdb1ed8_1236_47ad_a4e2_c35ae395abc0.slice/crio-05be386bd53d4e9e7caf8567f8e830381e3e5c7d50af11f5b7b748ef1916f1c8 WatchSource:0}: Error finding container 05be386bd53d4e9e7caf8567f8e830381e3e5c7d50af11f5b7b748ef1916f1c8: Status 404 returned error can't find the container with id 05be386bd53d4e9e7caf8567f8e830381e3e5c7d50af11f5b7b748ef1916f1c8
Jul 03 15:23:30.247219 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.247203    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 15:23:30.265860 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.265833    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-k7wm5"]
Jul 03 15:23:30.267688 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:23:30.267658    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915f7837_74eb_4459_86a3_30343cce1762.slice/crio-86bfd54705be29a4e104aaaa4c64fdd192c39aac11d1dc9a931fa0857812b1c3 WatchSource:0}: Error finding container 86bfd54705be29a4e104aaaa4c64fdd192c39aac11d1dc9a931fa0857812b1c3: Status 404 returned error can't find the container with id 86bfd54705be29a4e104aaaa4c64fdd192c39aac11d1dc9a931fa0857812b1c3
Jul 03 15:23:30.310873 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:30.310848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8755677bc-b89qj"]
Jul 03 15:23:30.313201 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:23:30.313166    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b38226_3fe3_4508_9ea4_48ffcec006f0.slice/crio-966be1c7c34f19df76f1b53a551fd9f2ee115e70a44523c9534d483c7e1609f6 WatchSource:0}: Error finding container 966be1c7c34f19df76f1b53a551fd9f2ee115e70a44523c9534d483c7e1609f6: Status 404 returned error can't find the container with id 966be1c7c34f19df76f1b53a551fd9f2ee115e70a44523c9534d483c7e1609f6
Jul 03 15:23:31.132231 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:31.132192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5" event={"ID":"915f7837-74eb-4459-86a3-30343cce1762","Type":"ContainerStarted","Data":"86bfd54705be29a4e104aaaa4c64fdd192c39aac11d1dc9a931fa0857812b1c3"}
Jul 03 15:23:31.134035 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:31.134003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7" event={"ID":"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0","Type":"ContainerStarted","Data":"05be386bd53d4e9e7caf8567f8e830381e3e5c7d50af11f5b7b748ef1916f1c8"}
Jul 03 15:23:31.135608 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:31.135582    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8755677bc-b89qj" event={"ID":"f4b38226-3fe3-4508-9ea4-48ffcec006f0","Type":"ContainerStarted","Data":"966be1c7c34f19df76f1b53a551fd9f2ee115e70a44523c9534d483c7e1609f6"}
Jul 03 15:23:32.145006 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:32.144969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5" event={"ID":"915f7837-74eb-4459-86a3-30343cce1762","Type":"ContainerStarted","Data":"1db832886e2f13f8725a97e0453f53a3adedcb838d48a6e8132eb3bd8a23aa29"}
Jul 03 15:23:32.145405 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:32.145036    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:23:32.146351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:32.146326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7" event={"ID":"4cdb1ed8-1236-47ad-a4e2-c35ae395abc0","Type":"ContainerStarted","Data":"68c4c84b01a1aded2fb0d72c11742cab390f2511d935ec9daa5ae2eb96e02223"}
Jul 03 15:23:32.146467 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:32.146405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:32.162596 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:32.162550    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5" podStartSLOduration=1.767656953 podStartE2EDuration="3.162532906s" totalImagesPullingTime="1.394875953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:23:32.160964734 +0000 UTC m=+612.635146338" watchObservedRunningTime="2026-07-03 15:23:32.162532906 +0000 UTC m=+612.636714488"
Jul 03 15:23:32.177215 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:32.177173    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7" podStartSLOduration=1.783788323 podStartE2EDuration="3.177157658s" totalImagesPullingTime="1.393369335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:23:32.175353506 +0000 UTC m=+612.649535112" watchObservedRunningTime="2026-07-03 15:23:32.177157658 +0000 UTC m=+612.651339260"
Jul 03 15:23:33.153000 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:33.152955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8755677bc-b89qj" event={"ID":"f4b38226-3fe3-4508-9ea4-48ffcec006f0","Type":"ContainerStarted","Data":"1409f9059b41cf00a1d2e114e39f68579c0845c735bd6ceb401038ddfc26774e"}
Jul 03 15:23:33.172747 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:33.172696    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8755677bc-b89qj" podStartSLOduration=2.412440344 podStartE2EDuration="4.172681534s" totalImagesPullingTime="1.76024119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:23:33.171079345 +0000 UTC m=+613.645260950" watchObservedRunningTime="2026-07-03 15:23:33.172681534 +0000 UTC m=+613.646863138"
Jul 03 15:23:34.157959 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:34.157926    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:40.168592 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:40.168564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8755677bc-b89qj"
Jul 03 15:23:43.155319 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:43.155289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-6vwr7"
Jul 03 15:23:43.155741 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:23:43.155355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-k7wm5"
Jul 03 15:24:00.085963 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.085928    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"]
Jul 03 15:24:00.089879 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.089856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.092771 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.092746    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hxtbm\""
Jul 03 15:24:00.092983 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.092970    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 03 15:24:00.094341 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.094323    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 03 15:24:00.094445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.094394    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 03 15:24:00.099173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.099142    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"]
Jul 03 15:24:00.189907 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.189869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz7ct\" (UniqueName: \"kubernetes.io/projected/5c1d844b-a064-4e01-9f0a-80755b669ab7-kube-api-access-wz7ct\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.190073 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.189919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.190073 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.190000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.190073 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.190029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.190073 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.190044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.190207 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.190102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1d844b-a064-4e01-9f0a-80755b669ab7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.290750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.290716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.290931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.290770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.290931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.290888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.291004 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.290927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.291044 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.291020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1d844b-a064-4e01-9f0a-80755b669ab7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.291088 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.291075    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.291137 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.291093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz7ct\" (UniqueName: \"kubernetes.io/projected/5c1d844b-a064-4e01-9f0a-80755b669ab7-kube-api-access-wz7ct\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.291189 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.291168    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.291304 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.291283    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.293418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.293393    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1d844b-a064-4e01-9f0a-80755b669ab7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.293514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.293476    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1d844b-a064-4e01-9f0a-80755b669ab7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.299319 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.299300    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz7ct\" (UniqueName: \"kubernetes.io/projected/5c1d844b-a064-4e01-9f0a-80755b669ab7-kube-api-access-wz7ct\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7\" (UID: \"5c1d844b-a064-4e01-9f0a-80755b669ab7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.401508 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.401470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:00.553729 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:00.553701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"]
Jul 03 15:24:00.556119 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:24:00.556093    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1d844b_a064_4e01_9f0a_80755b669ab7.slice/crio-69ea84540236142e95435330b0f705251f7fd9c92e40c085e3f88363a6402e29 WatchSource:0}: Error finding container 69ea84540236142e95435330b0f705251f7fd9c92e40c085e3f88363a6402e29: Status 404 returned error can't find the container with id 69ea84540236142e95435330b0f705251f7fd9c92e40c085e3f88363a6402e29
Jul 03 15:24:01.291269 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:01.291229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7" event={"ID":"5c1d844b-a064-4e01-9f0a-80755b669ab7","Type":"ContainerStarted","Data":"69ea84540236142e95435330b0f705251f7fd9c92e40c085e3f88363a6402e29"}
Jul 03 15:24:02.308401 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:02.308348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7" event={"ID":"5c1d844b-a064-4e01-9f0a-80755b669ab7","Type":"ContainerStarted","Data":"ac84e2ebad087d2895b6118574c9cc668c93e6b23b61fdc54cd48249d78ad631"}
Jul 03 15:24:02.326740 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:02.326684    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7" podStartSLOduration=1.1403349839999999 podStartE2EDuration="2.326667148s" totalImagesPullingTime="1.186332164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:24:02.325585019 +0000 UTC m=+642.799766624" watchObservedRunningTime="2026-07-03 15:24:02.326667148 +0000 UTC m=+642.800848787"
Jul 03 15:24:10.402237 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:10.402197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:10.402683 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:10.402265    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:10.414469 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:10.414444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:11.363179 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:11.363155    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7"
Jul 03 15:24:34.099556 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.099521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"]
Jul 03 15:24:34.106603 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.106579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.109697 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.109657    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 03 15:24:34.113776 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.113739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"]
Jul 03 15:24:34.205631 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.205599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.205631 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.205635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.205894 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.205667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ssm\" (UniqueName: \"kubernetes.io/projected/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-kube-api-access-92ssm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.205894 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.205737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.205894 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.205814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.205894 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.205835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306444 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306623 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306623 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92ssm\" (UniqueName: \"kubernetes.io/projected/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-kube-api-access-92ssm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306623 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306623 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306820 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.306899 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306877    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.307024 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.306926    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.307186 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.307162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.308975 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.308952    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.308975 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.308968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.314543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.314516    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ssm\" (UniqueName: \"kubernetes.io/projected/b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d-kube-api-access-92ssm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74b2z\" (UID: \"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.420706 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.420616    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:34.555906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:34.555873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"]
Jul 03 15:24:34.559559 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:24:34.559530    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c6152f_ebb0_47f1_bec9_ad6e1e60f04d.slice/crio-d06e99689f4b279d7619ab7c23d8d503d5a846bc1bcf6b158279256703a3b305 WatchSource:0}: Error finding container d06e99689f4b279d7619ab7c23d8d503d5a846bc1bcf6b158279256703a3b305: Status 404 returned error can't find the container with id d06e99689f4b279d7619ab7c23d8d503d5a846bc1bcf6b158279256703a3b305
Jul 03 15:24:35.468442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:35.468401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z" event={"ID":"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d","Type":"ContainerStarted","Data":"9ad7c1cc481998bc3213219b1136a8f21898d075ce3da92e000ce5cf34cf5da6"}
Jul 03 15:24:35.468812 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:35.468462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z" event={"ID":"b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d","Type":"ContainerStarted","Data":"d06e99689f4b279d7619ab7c23d8d503d5a846bc1bcf6b158279256703a3b305"}
Jul 03 15:24:35.488312 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:35.488261    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z" podStartSLOduration=1.28092453 podStartE2EDuration="1.488243428s" totalImagesPullingTime="207.318898ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:24:35.486657855 +0000 UTC m=+675.960839459" watchObservedRunningTime="2026-07-03 15:24:35.488243428 +0000 UTC m=+675.962425032"
Jul 03 15:24:44.420751 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:44.420711    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:44.421220 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:44.420778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:44.432822 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:44.432790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:44.522037 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:44.522008    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74b2z"
Jul 03 15:24:45.994789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:45.994753    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"]
Jul 03 15:24:45.998605 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:45.998587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.001237 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.001217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 03 15:24:46.014157 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.014128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"]
Jul 03 15:24:46.121553 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.121515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.121712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.121651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.121754 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.121718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h22p\" (UniqueName: \"kubernetes.io/projected/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-kube-api-access-7h22p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.121754 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.121745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.121815 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.121786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.121815 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.121812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.222552 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.222732 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h22p\" (UniqueName: \"kubernetes.io/projected/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-kube-api-access-7h22p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.222732 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.222732 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.222732 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.222944 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.223038 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.222999    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.223171 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.223066    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.223171 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.223075    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.225002 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.224980    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.225218 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.225199    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.230924 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.230902    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h22p\" (UniqueName: \"kubernetes.io/projected/9d08cd56-a25b-4dce-b35d-f6d892b06d7b-kube-api-access-7h22p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rv5l4\" (UID: \"9d08cd56-a25b-4dce-b35d-f6d892b06d7b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.310865 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.310781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:46.447021 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.446994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"]
Jul 03 15:24:46.449213 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:24:46.449187    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d08cd56_a25b_4dce_b35d_f6d892b06d7b.slice/crio-49a79e77cb612e5c8e0940aa6c1f9b64e864544db296e4ec8b2855f403b86d1f WatchSource:0}: Error finding container 49a79e77cb612e5c8e0940aa6c1f9b64e864544db296e4ec8b2855f403b86d1f: Status 404 returned error can't find the container with id 49a79e77cb612e5c8e0940aa6c1f9b64e864544db296e4ec8b2855f403b86d1f
Jul 03 15:24:46.522856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:46.522818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4" event={"ID":"9d08cd56-a25b-4dce-b35d-f6d892b06d7b","Type":"ContainerStarted","Data":"49a79e77cb612e5c8e0940aa6c1f9b64e864544db296e4ec8b2855f403b86d1f"}
Jul 03 15:24:47.529171 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:47.529130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4" event={"ID":"9d08cd56-a25b-4dce-b35d-f6d892b06d7b","Type":"ContainerStarted","Data":"b67ce51d7f99892e682e8b90838e79e71c49ea4b7ba478f582a5625ea0eb6e8d"}
Jul 03 15:24:47.548659 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:47.548612    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4" podStartSLOduration=2.367357794 podStartE2EDuration="2.548589331s" totalImagesPullingTime="181.231537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:24:47.547698077 +0000 UTC m=+688.021879682" watchObservedRunningTime="2026-07-03 15:24:47.548589331 +0000 UTC m=+688.022770936"
Jul 03 15:24:56.311315 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:56.311267    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:56.311750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:56.311343    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:56.323479 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:56.323455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:24:56.583391 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:24:56.583295    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rv5l4"
Jul 03 15:27:30.829773 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:30.829731    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-mp6x7"]
Jul 03 15:27:30.830382 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:30.830041    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7767ddc58d-mp6x7" podUID="babef3a1-028c-4ae6-b830-b33b4cd456f6" containerName="manager" containerID="cri-o://d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270" gracePeriod=30
Jul 03 15:27:31.081847 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.081789    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:27:31.254188 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.254154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/babef3a1-028c-4ae6-b830-b33b4cd456f6-webhook-cert\") pod \"babef3a1-028c-4ae6-b830-b33b4cd456f6\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") "
Jul 03 15:27:31.254415 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.254283    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skkws\" (UniqueName: \"kubernetes.io/projected/babef3a1-028c-4ae6-b830-b33b4cd456f6-kube-api-access-skkws\") pod \"babef3a1-028c-4ae6-b830-b33b4cd456f6\" (UID: \"babef3a1-028c-4ae6-b830-b33b4cd456f6\") "
Jul 03 15:27:31.256533 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.256500    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/babef3a1-028c-4ae6-b830-b33b4cd456f6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "babef3a1-028c-4ae6-b830-b33b4cd456f6" (UID: "babef3a1-028c-4ae6-b830-b33b4cd456f6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:27:31.256533 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.256507    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babef3a1-028c-4ae6-b830-b33b4cd456f6-kube-api-access-skkws" (OuterVolumeSpecName: "kube-api-access-skkws") pod "babef3a1-028c-4ae6-b830-b33b4cd456f6" (UID: "babef3a1-028c-4ae6-b830-b33b4cd456f6"). InnerVolumeSpecName "kube-api-access-skkws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:27:31.346795 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.346763    2579 generic.go:356] "Generic (PLEG): container finished" podID="babef3a1-028c-4ae6-b830-b33b4cd456f6" containerID="d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270" exitCode=0
Jul 03 15:27:31.346977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.346809    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767ddc58d-mp6x7"
Jul 03 15:27:31.346977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.346817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767ddc58d-mp6x7" event={"ID":"babef3a1-028c-4ae6-b830-b33b4cd456f6","Type":"ContainerDied","Data":"d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270"}
Jul 03 15:27:31.346977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.346860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767ddc58d-mp6x7" event={"ID":"babef3a1-028c-4ae6-b830-b33b4cd456f6","Type":"ContainerDied","Data":"4309bed07ee7d11abd781b62f75712619921e855f3880b4c43f82dfe9077e65a"}
Jul 03 15:27:31.346977 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.346883    2579 scope.go:117] "RemoveContainer" containerID="d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270"
Jul 03 15:27:31.355269 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.355247    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/babef3a1-028c-4ae6-b830-b33b4cd456f6-webhook-cert\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:27:31.355425 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.355271    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skkws\" (UniqueName: \"kubernetes.io/projected/babef3a1-028c-4ae6-b830-b33b4cd456f6-kube-api-access-skkws\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:27:31.356467 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.356437    2579 scope.go:117] "RemoveContainer" containerID="d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270"
Jul 03 15:27:31.356741 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:27:31.356722    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270\": container with ID starting with d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270 not found: ID does not exist" containerID="d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270"
Jul 03 15:27:31.356803 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.356752    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270"} err="failed to get container status \"d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270\": rpc error: code = NotFound desc = could not find container \"d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270\": container with ID starting with d243be2a6a6d32e399140dc01b4f6f9745aa51139d85e3311b28453387f22270 not found: ID does not exist"
Jul 03 15:27:31.368886 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.368863    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-mp6x7"]
Jul 03 15:27:31.372425 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:31.372404    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-mp6x7"]
Jul 03 15:27:32.010242 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.010211    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babef3a1-028c-4ae6-b830-b33b4cd456f6" path="/var/lib/kubelet/pods/babef3a1-028c-4ae6-b830-b33b4cd456f6/volumes"
Jul 03 15:27:32.147948 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.147905    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7767ddc58d-6fdn2"]
Jul 03 15:27:32.148342 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.148325    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="babef3a1-028c-4ae6-b830-b33b4cd456f6" containerName="manager"
Jul 03 15:27:32.148342 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.148341    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="babef3a1-028c-4ae6-b830-b33b4cd456f6" containerName="manager"
Jul 03 15:27:32.148577 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.148470    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="babef3a1-028c-4ae6-b830-b33b4cd456f6" containerName="manager"
Jul 03 15:27:32.153337 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.153316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.157657 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.157634    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 03 15:27:32.157911 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.157635    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qpz5c\""
Jul 03 15:27:32.157911 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.157635    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 03 15:27:32.161409 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.161387    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-6fdn2"]
Jul 03 15:27:32.264330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.264239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jr4q\" (UniqueName: \"kubernetes.io/projected/98328199-8140-4969-98e1-78009c3a4dc0-kube-api-access-4jr4q\") pod \"maas-controller-7767ddc58d-6fdn2\" (UID: \"98328199-8140-4969-98e1-78009c3a4dc0\") " pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.264330 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.264309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98328199-8140-4969-98e1-78009c3a4dc0-webhook-cert\") pod \"maas-controller-7767ddc58d-6fdn2\" (UID: \"98328199-8140-4969-98e1-78009c3a4dc0\") " pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.365085 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.365049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jr4q\" (UniqueName: \"kubernetes.io/projected/98328199-8140-4969-98e1-78009c3a4dc0-kube-api-access-4jr4q\") pod \"maas-controller-7767ddc58d-6fdn2\" (UID: \"98328199-8140-4969-98e1-78009c3a4dc0\") " pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.365277 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.365134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98328199-8140-4969-98e1-78009c3a4dc0-webhook-cert\") pod \"maas-controller-7767ddc58d-6fdn2\" (UID: \"98328199-8140-4969-98e1-78009c3a4dc0\") " pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.367726 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.367703    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98328199-8140-4969-98e1-78009c3a4dc0-webhook-cert\") pod \"maas-controller-7767ddc58d-6fdn2\" (UID: \"98328199-8140-4969-98e1-78009c3a4dc0\") " pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.374402 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.374346    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jr4q\" (UniqueName: \"kubernetes.io/projected/98328199-8140-4969-98e1-78009c3a4dc0-kube-api-access-4jr4q\") pod \"maas-controller-7767ddc58d-6fdn2\" (UID: \"98328199-8140-4969-98e1-78009c3a4dc0\") " pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.465805 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.465762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:32.605789 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:32.605757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7767ddc58d-6fdn2"]
Jul 03 15:27:32.608106 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:27:32.608065    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98328199_8140_4969_98e1_78009c3a4dc0.slice/crio-26086eca9336d9207b7ce902379111c2ea0ad95f14920bfa9390bbea5fb155d7 WatchSource:0}: Error finding container 26086eca9336d9207b7ce902379111c2ea0ad95f14920bfa9390bbea5fb155d7: Status 404 returned error can't find the container with id 26086eca9336d9207b7ce902379111c2ea0ad95f14920bfa9390bbea5fb155d7
Jul 03 15:27:33.359464 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:33.359426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767ddc58d-6fdn2" event={"ID":"98328199-8140-4969-98e1-78009c3a4dc0","Type":"ContainerStarted","Data":"3de8f6028edd228ca437e7aa6f401c69348f26a54ae2921d8e9da81578e73b46"}
Jul 03 15:27:33.359848 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:33.359489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7767ddc58d-6fdn2" event={"ID":"98328199-8140-4969-98e1-78009c3a4dc0","Type":"ContainerStarted","Data":"26086eca9336d9207b7ce902379111c2ea0ad95f14920bfa9390bbea5fb155d7"}
Jul 03 15:27:33.359848 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:33.359553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:44.375886 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:44.375855    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7767ddc58d-6fdn2"
Jul 03 15:27:44.393893 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:27:44.393844    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7767ddc58d-6fdn2" podStartSLOduration=12.010094049 podStartE2EDuration="12.393826713s" totalImagesPullingTime="383.732664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:27:33.375982865 +0000 UTC m=+853.850164471" watchObservedRunningTime="2026-07-03 15:27:44.393826713 +0000 UTC m=+864.868008338"
Jul 03 15:28:19.923515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:28:19.923432    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:28:19.924056 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:28:19.923707    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:30:00.149422 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.149324    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29718210-sr6jn"]
Jul 03 15:30:00.153093 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.153071    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:00.171797 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.171766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718210-sr6jn"]
Jul 03 15:30:00.317677 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.317635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqf5j\" (UniqueName: \"kubernetes.io/projected/e8433377-ebea-422f-8311-7480d9355777-kube-api-access-sqf5j\") pod \"maas-api-key-cleanup-29718210-sr6jn\" (UID: \"e8433377-ebea-422f-8311-7480d9355777\") " pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:00.419015 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.418916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqf5j\" (UniqueName: \"kubernetes.io/projected/e8433377-ebea-422f-8311-7480d9355777-kube-api-access-sqf5j\") pod \"maas-api-key-cleanup-29718210-sr6jn\" (UID: \"e8433377-ebea-422f-8311-7480d9355777\") " pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:00.427792 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.427760    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqf5j\" (UniqueName: \"kubernetes.io/projected/e8433377-ebea-422f-8311-7480d9355777-kube-api-access-sqf5j\") pod \"maas-api-key-cleanup-29718210-sr6jn\" (UID: \"e8433377-ebea-422f-8311-7480d9355777\") " pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:00.463219 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.463184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:00.598077 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.598043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718210-sr6jn"]
Jul 03 15:30:00.601974 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:30:00.601946    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8433377_ebea_422f_8311_7480d9355777.slice/crio-727b44a4ffaedc6a80450bc9c4c822ed36b6c4c8e712cb4310623afae0dbba91 WatchSource:0}: Error finding container 727b44a4ffaedc6a80450bc9c4c822ed36b6c4c8e712cb4310623afae0dbba91: Status 404 returned error can't find the container with id 727b44a4ffaedc6a80450bc9c4c822ed36b6c4c8e712cb4310623afae0dbba91
Jul 03 15:30:00.604111 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:00.604096    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 15:30:01.138162 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:01.138126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn" event={"ID":"e8433377-ebea-422f-8311-7480d9355777","Type":"ContainerStarted","Data":"727b44a4ffaedc6a80450bc9c4c822ed36b6c4c8e712cb4310623afae0dbba91"}
Jul 03 15:30:04.161431 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:04.161382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn" event={"ID":"e8433377-ebea-422f-8311-7480d9355777","Type":"ContainerStarted","Data":"b3821600bc1b0846e48b5c9dee3819d3b5f8ade88a17221719a9d194357af65a"}
Jul 03 15:30:04.176620 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:04.176515    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn" podStartSLOduration=1.093460102 podStartE2EDuration="4.176482415s" totalImagesPullingTime="3.083022313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:30:04.176479209 +0000 UTC m=+1004.650660811" watchObservedRunningTime="2026-07-03 15:30:04.176482415 +0000 UTC m=+1004.650664021"
Jul 03 15:30:05.169443 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:05.169404    2579 generic.go:356] "Generic (PLEG): container finished" podID="e8433377-ebea-422f-8311-7480d9355777" containerID="b3821600bc1b0846e48b5c9dee3819d3b5f8ade88a17221719a9d194357af65a" exitCode=0
Jul 03 15:30:05.169807 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:05.169483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn" event={"ID":"e8433377-ebea-422f-8311-7480d9355777","Type":"ContainerDied","Data":"b3821600bc1b0846e48b5c9dee3819d3b5f8ade88a17221719a9d194357af65a"}
Jul 03 15:30:06.310540 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:06.310515    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:06.376676 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:06.376635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqf5j\" (UniqueName: \"kubernetes.io/projected/e8433377-ebea-422f-8311-7480d9355777-kube-api-access-sqf5j\") pod \"e8433377-ebea-422f-8311-7480d9355777\" (UID: \"e8433377-ebea-422f-8311-7480d9355777\") "
Jul 03 15:30:06.378831 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:06.378808    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8433377-ebea-422f-8311-7480d9355777-kube-api-access-sqf5j" (OuterVolumeSpecName: "kube-api-access-sqf5j") pod "e8433377-ebea-422f-8311-7480d9355777" (UID: "e8433377-ebea-422f-8311-7480d9355777"). InnerVolumeSpecName "kube-api-access-sqf5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:30:06.477868 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:06.477792    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqf5j\" (UniqueName: \"kubernetes.io/projected/e8433377-ebea-422f-8311-7480d9355777-kube-api-access-sqf5j\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:30:07.181524 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:07.181492    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn"
Jul 03 15:30:07.181524 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:07.181508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718210-sr6jn" event={"ID":"e8433377-ebea-422f-8311-7480d9355777","Type":"ContainerDied","Data":"727b44a4ffaedc6a80450bc9c4c822ed36b6c4c8e712cb4310623afae0dbba91"}
Jul 03 15:30:07.181731 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:30:07.181550    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="727b44a4ffaedc6a80450bc9c4c822ed36b6c4c8e712cb4310623afae0dbba91"
Jul 03 15:33:19.956904 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:33:19.956816    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:33:19.959460 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:33:19.959434    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:38:19.997613 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:38:19.997585    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:38:20.000891 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:38:20.000872    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:39:35.388880 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.388844    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"]
Jul 03 15:39:35.389331 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.389314    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8433377-ebea-422f-8311-7480d9355777" containerName="cleanup"
Jul 03 15:39:35.389331 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.389328    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8433377-ebea-422f-8311-7480d9355777" containerName="cleanup"
Jul 03 15:39:35.389435 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.389423    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8433377-ebea-422f-8311-7480d9355777" containerName="cleanup"
Jul 03 15:39:35.392757 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.392740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.396523 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.396501    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-bb2882d3-serving-cert\""
Jul 03 15:39:35.415663 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.415629    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"]
Jul 03 15:39:35.517788 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.517748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g8dw\" (UniqueName: \"kubernetes.io/projected/e931fa93-a3c2-408b-9113-98f6431f4f36-kube-api-access-2g8dw\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.518010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.517829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e931fa93-a3c2-408b-9113-98f6431f4f36-openshift-service-ca\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.518010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.517873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e931fa93-a3c2-408b-9113-98f6431f4f36-maas-api-tls\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.619140 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.619093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g8dw\" (UniqueName: \"kubernetes.io/projected/e931fa93-a3c2-408b-9113-98f6431f4f36-kube-api-access-2g8dw\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.619440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.619182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e931fa93-a3c2-408b-9113-98f6431f4f36-openshift-service-ca\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.619440 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.619219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e931fa93-a3c2-408b-9113-98f6431f4f36-maas-api-tls\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.620047 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.620015    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e931fa93-a3c2-408b-9113-98f6431f4f36-openshift-service-ca\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.622084 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.622063    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e931fa93-a3c2-408b-9113-98f6431f4f36-maas-api-tls\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.628019 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.627998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g8dw\" (UniqueName: \"kubernetes.io/projected/e931fa93-a3c2-408b-9113-98f6431f4f36-kube-api-access-2g8dw\") pod \"maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") " pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.704193 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.704087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:35.847001 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.846972    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"]
Jul 03 15:39:35.849279 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:39:35.849245    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode931fa93_a3c2_408b_9113_98f6431f4f36.slice/crio-3e27327815783de71187770c85aae7165c61a5eb6163349ac9a10308cea0f4ca WatchSource:0}: Error finding container 3e27327815783de71187770c85aae7165c61a5eb6163349ac9a10308cea0f4ca: Status 404 returned error can't find the container with id 3e27327815783de71187770c85aae7165c61a5eb6163349ac9a10308cea0f4ca
Jul 03 15:39:35.850778 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:35.850756    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 15:39:36.055506 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:36.055414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch" event={"ID":"e931fa93-a3c2-408b-9113-98f6431f4f36","Type":"ContainerStarted","Data":"3e27327815783de71187770c85aae7165c61a5eb6163349ac9a10308cea0f4ca"}
Jul 03 15:39:37.061803 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:37.061769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch" event={"ID":"e931fa93-a3c2-408b-9113-98f6431f4f36","Type":"ContainerStarted","Data":"c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d"}
Jul 03 15:39:37.062211 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:37.061836    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:37.081509 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:37.081457    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch" podStartSLOduration=1.692406621 podStartE2EDuration="2.081440546s" totalImagesPullingTime="389.033925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:39:37.079060358 +0000 UTC m=+1577.553241980" watchObservedRunningTime="2026-07-03 15:39:37.081440546 +0000 UTC m=+1577.555622151"
Jul 03 15:39:40.738376 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:40.738323    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"]
Jul 03 15:39:40.738900 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:40.738621    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch" podUID="e931fa93-a3c2-408b-9113-98f6431f4f36" containerName="maas-api" containerID="cri-o://c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d" gracePeriod=30
Jul 03 15:39:40.996194 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:40.996127    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:41.073875 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.073837    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e931fa93-a3c2-408b-9113-98f6431f4f36-maas-api-tls\") pod \"e931fa93-a3c2-408b-9113-98f6431f4f36\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") "
Jul 03 15:39:41.074069 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.073943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g8dw\" (UniqueName: \"kubernetes.io/projected/e931fa93-a3c2-408b-9113-98f6431f4f36-kube-api-access-2g8dw\") pod \"e931fa93-a3c2-408b-9113-98f6431f4f36\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") "
Jul 03 15:39:41.074069 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.074026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e931fa93-a3c2-408b-9113-98f6431f4f36-openshift-service-ca\") pod \"e931fa93-a3c2-408b-9113-98f6431f4f36\" (UID: \"e931fa93-a3c2-408b-9113-98f6431f4f36\") "
Jul 03 15:39:41.074502 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.074466    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e931fa93-a3c2-408b-9113-98f6431f4f36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e931fa93-a3c2-408b-9113-98f6431f4f36" (UID: "e931fa93-a3c2-408b-9113-98f6431f4f36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:39:41.076304 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.076280    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e931fa93-a3c2-408b-9113-98f6431f4f36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e931fa93-a3c2-408b-9113-98f6431f4f36" (UID: "e931fa93-a3c2-408b-9113-98f6431f4f36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:39:41.076304 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.076295    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e931fa93-a3c2-408b-9113-98f6431f4f36-kube-api-access-2g8dw" (OuterVolumeSpecName: "kube-api-access-2g8dw") pod "e931fa93-a3c2-408b-9113-98f6431f4f36" (UID: "e931fa93-a3c2-408b-9113-98f6431f4f36"). InnerVolumeSpecName "kube-api-access-2g8dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:39:41.083517 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.083484    2579 generic.go:356] "Generic (PLEG): container finished" podID="e931fa93-a3c2-408b-9113-98f6431f4f36" containerID="c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d" exitCode=0
Jul 03 15:39:41.083629 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.083547    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"
Jul 03 15:39:41.083629 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.083574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch" event={"ID":"e931fa93-a3c2-408b-9113-98f6431f4f36","Type":"ContainerDied","Data":"c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d"}
Jul 03 15:39:41.083734 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.083639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch" event={"ID":"e931fa93-a3c2-408b-9113-98f6431f4f36","Type":"ContainerDied","Data":"3e27327815783de71187770c85aae7165c61a5eb6163349ac9a10308cea0f4ca"}
Jul 03 15:39:41.083734 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.083662    2579 scope.go:117] "RemoveContainer" containerID="c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d"
Jul 03 15:39:41.093295 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.093276    2579 scope.go:117] "RemoveContainer" containerID="c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d"
Jul 03 15:39:41.093602 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:39:41.093581    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d\": container with ID starting with c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d not found: ID does not exist" containerID="c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d"
Jul 03 15:39:41.093674 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.093609    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d"} err="failed to get container status \"c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d\": rpc error: code = NotFound desc = could not find container \"c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d\": container with ID starting with c6f26f116396ef00c78d7d0daa043b2dbe96433883d91b86a0beb537f1b9423d not found: ID does not exist"
Jul 03 15:39:41.105217 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.105193    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"]
Jul 03 15:39:41.110637 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.110616    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-bb2882d3-7694956f5c-8xmch"]
Jul 03 15:39:41.175478 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.175444    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g8dw\" (UniqueName: \"kubernetes.io/projected/e931fa93-a3c2-408b-9113-98f6431f4f36-kube-api-access-2g8dw\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:39:41.175478 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.175474    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e931fa93-a3c2-408b-9113-98f6431f4f36-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:39:41.175478 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:41.175485    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e931fa93-a3c2-408b-9113-98f6431f4f36-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:39:42.010958 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:42.010922    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e931fa93-a3c2-408b-9113-98f6431f4f36" path="/var/lib/kubelet/pods/e931fa93-a3c2-408b-9113-98f6431f4f36/volumes"
Jul 03 15:39:47.859061 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.859029    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"]
Jul 03 15:39:47.859570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.859555    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e931fa93-a3c2-408b-9113-98f6431f4f36" containerName="maas-api"
Jul 03 15:39:47.859619 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.859572    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e931fa93-a3c2-408b-9113-98f6431f4f36" containerName="maas-api"
Jul 03 15:39:47.859654 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.859643    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e931fa93-a3c2-408b-9113-98f6431f4f36" containerName="maas-api"
Jul 03 15:39:47.864308 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.864287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:47.867542 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.867519    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-39081e64-serving-cert\""
Jul 03 15:39:47.879537 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.879506    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"]
Jul 03 15:39:47.953629 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.953590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq4rp\" (UniqueName: \"kubernetes.io/projected/44b91341-3353-4809-937e-abc503753210-kube-api-access-vq4rp\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:47.953816 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.953639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44b91341-3353-4809-937e-abc503753210-maas-api-tls\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:47.953816 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:47.953733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b91341-3353-4809-937e-abc503753210-openshift-service-ca\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.055060 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.055023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq4rp\" (UniqueName: \"kubernetes.io/projected/44b91341-3353-4809-937e-abc503753210-kube-api-access-vq4rp\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.055256 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.055082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44b91341-3353-4809-937e-abc503753210-maas-api-tls\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.055256 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.055144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b91341-3353-4809-937e-abc503753210-openshift-service-ca\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.055859 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.055833    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b91341-3353-4809-937e-abc503753210-openshift-service-ca\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.057817 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.057792    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44b91341-3353-4809-937e-abc503753210-maas-api-tls\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.065340 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.065317    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq4rp\" (UniqueName: \"kubernetes.io/projected/44b91341-3353-4809-937e-abc503753210-kube-api-access-vq4rp\") pod \"maas-api-e2e-ait-39081e64-8847b65db-vqk4q\" (UID: \"44b91341-3353-4809-937e-abc503753210\") " pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.174877 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.174793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:48.329132 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:48.329103    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"]
Jul 03 15:39:48.331230 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:39:48.331199    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b91341_3353_4809_937e_abc503753210.slice/crio-e74181e8f2da2d408d44a3fb5f0ff4a3a472002d78ecbf9ac0461ab79d59abec WatchSource:0}: Error finding container e74181e8f2da2d408d44a3fb5f0ff4a3a472002d78ecbf9ac0461ab79d59abec: Status 404 returned error can't find the container with id e74181e8f2da2d408d44a3fb5f0ff4a3a472002d78ecbf9ac0461ab79d59abec
Jul 03 15:39:49.127018 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:49.126974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q" event={"ID":"44b91341-3353-4809-937e-abc503753210","Type":"ContainerStarted","Data":"23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b"}
Jul 03 15:39:49.127511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:49.127052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:49.127511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:49.127079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q" event={"ID":"44b91341-3353-4809-937e-abc503753210","Type":"ContainerStarted","Data":"e74181e8f2da2d408d44a3fb5f0ff4a3a472002d78ecbf9ac0461ab79d59abec"}
Jul 03 15:39:49.153779 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:49.153727    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q" podStartSLOduration=1.82211378 podStartE2EDuration="2.1537103s" totalImagesPullingTime="331.59652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:39:49.149765069 +0000 UTC m=+1589.623946674" watchObservedRunningTime="2026-07-03 15:39:49.1537103 +0000 UTC m=+1589.627891904"
Jul 03 15:39:53.259589 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.256774    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"]
Jul 03 15:39:53.259589 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.257084    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q" podUID="44b91341-3353-4809-937e-abc503753210" containerName="maas-api" containerID="cri-o://23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b" gracePeriod=30
Jul 03 15:39:53.264391 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.264352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:53.518655 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.518586    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:53.608742 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.608688    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44b91341-3353-4809-937e-abc503753210-maas-api-tls\") pod \"44b91341-3353-4809-937e-abc503753210\" (UID: \"44b91341-3353-4809-937e-abc503753210\") "
Jul 03 15:39:53.608955 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.608761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b91341-3353-4809-937e-abc503753210-openshift-service-ca\") pod \"44b91341-3353-4809-937e-abc503753210\" (UID: \"44b91341-3353-4809-937e-abc503753210\") "
Jul 03 15:39:53.608955 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.608817    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq4rp\" (UniqueName: \"kubernetes.io/projected/44b91341-3353-4809-937e-abc503753210-kube-api-access-vq4rp\") pod \"44b91341-3353-4809-937e-abc503753210\" (UID: \"44b91341-3353-4809-937e-abc503753210\") "
Jul 03 15:39:53.609141 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.609111    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b91341-3353-4809-937e-abc503753210-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44b91341-3353-4809-937e-abc503753210" (UID: "44b91341-3353-4809-937e-abc503753210"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:39:53.609323 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.609307    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44b91341-3353-4809-937e-abc503753210-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:39:53.610983 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.610958    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b91341-3353-4809-937e-abc503753210-kube-api-access-vq4rp" (OuterVolumeSpecName: "kube-api-access-vq4rp") pod "44b91341-3353-4809-937e-abc503753210" (UID: "44b91341-3353-4809-937e-abc503753210"). InnerVolumeSpecName "kube-api-access-vq4rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:39:53.611067 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.611039    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b91341-3353-4809-937e-abc503753210-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44b91341-3353-4809-937e-abc503753210" (UID: "44b91341-3353-4809-937e-abc503753210"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:39:53.709957 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.709924    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq4rp\" (UniqueName: \"kubernetes.io/projected/44b91341-3353-4809-937e-abc503753210-kube-api-access-vq4rp\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:39:53.709957 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:53.709953    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44b91341-3353-4809-937e-abc503753210-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:39:54.157031 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.156992    2579 generic.go:356] "Generic (PLEG): container finished" podID="44b91341-3353-4809-937e-abc503753210" containerID="23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b" exitCode=0
Jul 03 15:39:54.157200 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.157038    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"
Jul 03 15:39:54.157200 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.157096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q" event={"ID":"44b91341-3353-4809-937e-abc503753210","Type":"ContainerDied","Data":"23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b"}
Jul 03 15:39:54.157200 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.157153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q" event={"ID":"44b91341-3353-4809-937e-abc503753210","Type":"ContainerDied","Data":"e74181e8f2da2d408d44a3fb5f0ff4a3a472002d78ecbf9ac0461ab79d59abec"}
Jul 03 15:39:54.157200 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.157176    2579 scope.go:117] "RemoveContainer" containerID="23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b"
Jul 03 15:39:54.165965 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.165946    2579 scope.go:117] "RemoveContainer" containerID="23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b"
Jul 03 15:39:54.166255 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:39:54.166239    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b\": container with ID starting with 23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b not found: ID does not exist" containerID="23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b"
Jul 03 15:39:54.166304 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.166265    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b"} err="failed to get container status \"23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b\": rpc error: code = NotFound desc = could not find container \"23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b\": container with ID starting with 23e1215689807830c5f0f29aa820f80bc9489224c9861fbb83bea2eb187ca69b not found: ID does not exist"
Jul 03 15:39:54.187738 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.187699    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"]
Jul 03 15:39:54.189683 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:54.189662    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-39081e64-8847b65db-vqk4q"]
Jul 03 15:39:56.011289 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:39:56.011252    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b91341-3353-4809-937e-abc503753210" path="/var/lib/kubelet/pods/44b91341-3353-4809-937e-abc503753210/volumes"
Jul 03 15:40:06.665151 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.665114    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"]
Jul 03 15:40:06.665637 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.665620    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b91341-3353-4809-937e-abc503753210" containerName="maas-api"
Jul 03 15:40:06.665637 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.665638    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b91341-3353-4809-937e-abc503753210" containerName="maas-api"
Jul 03 15:40:06.665717 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.665710    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b91341-3353-4809-937e-abc503753210" containerName="maas-api"
Jul 03 15:40:06.670053 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.670033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.672982 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.672959    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-162414cd-serving-cert\""
Jul 03 15:40:06.681096 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.681072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"]
Jul 03 15:40:06.747187 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.747149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tk8v\" (UniqueName: \"kubernetes.io/projected/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-kube-api-access-8tk8v\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.747187 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.747195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-maas-api-tls\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.747441 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.747325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-openshift-service-ca\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.847830 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.847786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-openshift-service-ca\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.847830 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.847830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tk8v\" (UniqueName: \"kubernetes.io/projected/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-kube-api-access-8tk8v\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.848116 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.847856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-maas-api-tls\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.848533 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.848512    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-openshift-service-ca\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.850419 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.850402    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-maas-api-tls\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.857192 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.857174    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tk8v\" (UniqueName: \"kubernetes.io/projected/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-kube-api-access-8tk8v\") pod \"maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") " pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:06.983589 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:06.983499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:07.138579 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:07.138429    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"]
Jul 03 15:40:07.141762 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:40:07.141729    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1b0b0f_ce40_46f1_868e_2878804e5f3a.slice/crio-3c36d1eb80ad231d89fbfa60472a7647f0c7af3df9893c254068f8225540f67c WatchSource:0}: Error finding container 3c36d1eb80ad231d89fbfa60472a7647f0c7af3df9893c254068f8225540f67c: Status 404 returned error can't find the container with id 3c36d1eb80ad231d89fbfa60472a7647f0c7af3df9893c254068f8225540f67c
Jul 03 15:40:07.223682 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:07.223647    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp" event={"ID":"2e1b0b0f-ce40-46f1-868e-2878804e5f3a","Type":"ContainerStarted","Data":"3c36d1eb80ad231d89fbfa60472a7647f0c7af3df9893c254068f8225540f67c"}
Jul 03 15:40:08.230463 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:08.230416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp" event={"ID":"2e1b0b0f-ce40-46f1-868e-2878804e5f3a","Type":"ContainerStarted","Data":"e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2"}
Jul 03 15:40:08.230934 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:08.230534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:08.250413 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:08.250353    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp" podStartSLOduration=1.897870865 podStartE2EDuration="2.250337351s" totalImagesPullingTime="352.466486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:40:08.248164533 +0000 UTC m=+1608.722346130" watchObservedRunningTime="2026-07-03 15:40:08.250337351 +0000 UTC m=+1608.724518955"
Jul 03 15:40:11.412138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.412045    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"]
Jul 03 15:40:11.412631 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.412429    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp" podUID="2e1b0b0f-ce40-46f1-868e-2878804e5f3a" containerName="maas-api" containerID="cri-o://e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2" gracePeriod=30
Jul 03 15:40:11.669032 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.668978    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:11.801679 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.801639    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-maas-api-tls\") pod \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") "
Jul 03 15:40:11.801896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.801775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-openshift-service-ca\") pod \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") "
Jul 03 15:40:11.801896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.801820    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tk8v\" (UniqueName: \"kubernetes.io/projected/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-kube-api-access-8tk8v\") pod \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\" (UID: \"2e1b0b0f-ce40-46f1-868e-2878804e5f3a\") "
Jul 03 15:40:11.802185 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.802149    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e1b0b0f-ce40-46f1-868e-2878804e5f3a" (UID: "2e1b0b0f-ce40-46f1-868e-2878804e5f3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:40:11.804029 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.803993    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e1b0b0f-ce40-46f1-868e-2878804e5f3a" (UID: "2e1b0b0f-ce40-46f1-868e-2878804e5f3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:40:11.804142 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.804072    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-kube-api-access-8tk8v" (OuterVolumeSpecName: "kube-api-access-8tk8v") pod "2e1b0b0f-ce40-46f1-868e-2878804e5f3a" (UID: "2e1b0b0f-ce40-46f1-868e-2878804e5f3a"). InnerVolumeSpecName "kube-api-access-8tk8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:40:11.902712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.902679    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:40:11.902712 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.902712    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tk8v\" (UniqueName: \"kubernetes.io/projected/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-kube-api-access-8tk8v\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:40:11.902912 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:11.902727    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e1b0b0f-ce40-46f1-868e-2878804e5f3a-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:40:12.253601 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.253561    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e1b0b0f-ce40-46f1-868e-2878804e5f3a" containerID="e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2" exitCode=0
Jul 03 15:40:12.253778 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.253605    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"
Jul 03 15:40:12.253778 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.253642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp" event={"ID":"2e1b0b0f-ce40-46f1-868e-2878804e5f3a","Type":"ContainerDied","Data":"e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2"}
Jul 03 15:40:12.253778 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.253694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp" event={"ID":"2e1b0b0f-ce40-46f1-868e-2878804e5f3a","Type":"ContainerDied","Data":"3c36d1eb80ad231d89fbfa60472a7647f0c7af3df9893c254068f8225540f67c"}
Jul 03 15:40:12.253778 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.253708    2579 scope.go:117] "RemoveContainer" containerID="e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2"
Jul 03 15:40:12.262763 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.262745    2579 scope.go:117] "RemoveContainer" containerID="e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2"
Jul 03 15:40:12.263029 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:40:12.263011    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2\": container with ID starting with e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2 not found: ID does not exist" containerID="e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2"
Jul 03 15:40:12.263104 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.263042    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2"} err="failed to get container status \"e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2\": rpc error: code = NotFound desc = could not find container \"e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2\": container with ID starting with e834a24a7b089ffbcd096aa39b00b66289b9e75114f41a85c698df599d8682b2 not found: ID does not exist"
Jul 03 15:40:12.272382 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.272309    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"]
Jul 03 15:40:12.276591 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:12.276567    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-162414cd-7687cb4b7b-k28xp"]
Jul 03 15:40:14.010319 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:40:14.010281    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1b0b0f-ce40-46f1-868e-2878804e5f3a" path="/var/lib/kubelet/pods/2e1b0b0f-ce40-46f1-868e-2878804e5f3a/volumes"
Jul 03 15:41:56.745708 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.745629    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"]
Jul 03 15:41:56.748010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.746065    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1b0b0f-ce40-46f1-868e-2878804e5f3a" containerName="maas-api"
Jul 03 15:41:56.748010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.746076    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1b0b0f-ce40-46f1-868e-2878804e5f3a" containerName="maas-api"
Jul 03 15:41:56.748010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.746147    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1b0b0f-ce40-46f1-868e-2878804e5f3a" containerName="maas-api"
Jul 03 15:41:56.749074 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.749058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.751888 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.751869    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-f7d4fbbe-serving-cert\""
Jul 03 15:41:56.760721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.760697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"]
Jul 03 15:41:56.814125 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.814086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d65669e-759c-4574-9812-83235befa207-openshift-service-ca\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.814307 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.814171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.814307 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.814199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvlh\" (UniqueName: \"kubernetes.io/projected/4d65669e-759c-4574-9812-83235befa207-kube-api-access-hlvlh\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.915222 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.915176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d65669e-759c-4574-9812-83235befa207-openshift-service-ca\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.915462 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.915254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.915462 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.915287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvlh\" (UniqueName: \"kubernetes.io/projected/4d65669e-759c-4574-9812-83235befa207-kube-api-access-hlvlh\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.915462 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:41:56.915419    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-f7d4fbbe-serving-cert: secret "maas-api-e2e-mt-f7d4fbbe-serving-cert" not found
Jul 03 15:41:56.915648 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:41:56.915493    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls podName:4d65669e-759c-4574-9812-83235befa207 nodeName:}" failed. No retries permitted until 2026-07-03 15:41:57.415475029 +0000 UTC m=+1717.889656613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls") pod "maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" (UID: "4d65669e-759c-4574-9812-83235befa207") : secret "maas-api-e2e-mt-f7d4fbbe-serving-cert" not found
Jul 03 15:41:56.915821 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.915800    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d65669e-759c-4574-9812-83235befa207-openshift-service-ca\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:56.927284 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:56.927255    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvlh\" (UniqueName: \"kubernetes.io/projected/4d65669e-759c-4574-9812-83235befa207-kube-api-access-hlvlh\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:57.420301 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:57.420259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:57.422991 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:57.422966    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls\") pod \"maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") " pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:57.661450 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:57.661411    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:57.806671 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:57.806552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"]
Jul 03 15:41:57.809584 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:41:57.809553    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d65669e_759c_4574_9812_83235befa207.slice/crio-bf8a634037bd0698c570b9b8dd9b31703d23ef8135d8513a4aa27a14d6766b60 WatchSource:0}: Error finding container bf8a634037bd0698c570b9b8dd9b31703d23ef8135d8513a4aa27a14d6766b60: Status 404 returned error can't find the container with id bf8a634037bd0698c570b9b8dd9b31703d23ef8135d8513a4aa27a14d6766b60
Jul 03 15:41:58.800018 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:58.799968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" event={"ID":"4d65669e-759c-4574-9812-83235befa207","Type":"ContainerStarted","Data":"7e8c05970f8e6417c05d46e7e2b17c3c76a253342111ffac564253d4a031d6ff"}
Jul 03 15:41:58.800206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:58.800028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" event={"ID":"4d65669e-759c-4574-9812-83235befa207","Type":"ContainerStarted","Data":"bf8a634037bd0698c570b9b8dd9b31703d23ef8135d8513a4aa27a14d6766b60"}
Jul 03 15:41:58.800206 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:58.800050    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:41:58.821288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:41:58.821226    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" podStartSLOduration=2.429081296 podStartE2EDuration="2.821207912s" totalImagesPullingTime="392.126616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:41:58.818723799 +0000 UTC m=+1719.292905418" watchObservedRunningTime="2026-07-03 15:41:58.821207912 +0000 UTC m=+1719.295389511"
Jul 03 15:42:04.810649 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:04.810610    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:42:08.730576 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:08.730543    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"]
Jul 03 15:42:08.731053 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:08.730817    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" podUID="4d65669e-759c-4574-9812-83235befa207" containerName="maas-api" containerID="cri-o://7e8c05970f8e6417c05d46e7e2b17c3c76a253342111ffac564253d4a031d6ff" gracePeriod=30
Jul 03 15:42:08.864420 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:08.864345    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d65669e-759c-4574-9812-83235befa207" containerID="7e8c05970f8e6417c05d46e7e2b17c3c76a253342111ffac564253d4a031d6ff" exitCode=0
Jul 03 15:42:08.864627 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:08.864550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" event={"ID":"4d65669e-759c-4574-9812-83235befa207","Type":"ContainerDied","Data":"7e8c05970f8e6417c05d46e7e2b17c3c76a253342111ffac564253d4a031d6ff"}
Jul 03 15:42:08.998048 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:08.998023    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:42:09.139688 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.139645    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlvlh\" (UniqueName: \"kubernetes.io/projected/4d65669e-759c-4574-9812-83235befa207-kube-api-access-hlvlh\") pod \"4d65669e-759c-4574-9812-83235befa207\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") "
Jul 03 15:42:09.139893 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.139750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d65669e-759c-4574-9812-83235befa207-openshift-service-ca\") pod \"4d65669e-759c-4574-9812-83235befa207\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") "
Jul 03 15:42:09.139893 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.139778    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls\") pod \"4d65669e-759c-4574-9812-83235befa207\" (UID: \"4d65669e-759c-4574-9812-83235befa207\") "
Jul 03 15:42:09.140203 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.140170    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d65669e-759c-4574-9812-83235befa207-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d65669e-759c-4574-9812-83235befa207" (UID: "4d65669e-759c-4574-9812-83235befa207"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:42:09.142020 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.141985    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d65669e-759c-4574-9812-83235befa207" (UID: "4d65669e-759c-4574-9812-83235befa207"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:42:09.142114 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.142023    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d65669e-759c-4574-9812-83235befa207-kube-api-access-hlvlh" (OuterVolumeSpecName: "kube-api-access-hlvlh") pod "4d65669e-759c-4574-9812-83235befa207" (UID: "4d65669e-759c-4574-9812-83235befa207"). InnerVolumeSpecName "kube-api-access-hlvlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:42:09.240521 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.240412    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlvlh\" (UniqueName: \"kubernetes.io/projected/4d65669e-759c-4574-9812-83235befa207-kube-api-access-hlvlh\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:42:09.240521 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.240461    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d65669e-759c-4574-9812-83235befa207-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:42:09.240521 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.240471    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d65669e-759c-4574-9812-83235befa207-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:42:09.871510 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.871478    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"
Jul 03 15:42:09.871958 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.871513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm" event={"ID":"4d65669e-759c-4574-9812-83235befa207","Type":"ContainerDied","Data":"bf8a634037bd0698c570b9b8dd9b31703d23ef8135d8513a4aa27a14d6766b60"}
Jul 03 15:42:09.871958 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.871581    2579 scope.go:117] "RemoveContainer" containerID="7e8c05970f8e6417c05d46e7e2b17c3c76a253342111ffac564253d4a031d6ff"
Jul 03 15:42:09.895887 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.895862    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"]
Jul 03 15:42:09.899918 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:09.899895    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d4fbbe-78456c5c5c-lmxlm"]
Jul 03 15:42:10.010602 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:10.010562    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d65669e-759c-4574-9812-83235befa207" path="/var/lib/kubelet/pods/4d65669e-759c-4574-9812-83235befa207/volumes"
Jul 03 15:42:38.133178 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.133139    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"]
Jul 03 15:42:38.133721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.133604    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d65669e-759c-4574-9812-83235befa207" containerName="maas-api"
Jul 03 15:42:38.133721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.133616    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d65669e-759c-4574-9812-83235befa207" containerName="maas-api"
Jul 03 15:42:38.133721 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.133678    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d65669e-759c-4574-9812-83235befa207" containerName="maas-api"
Jul 03 15:42:38.136799 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.136775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.139790 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.139770    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-37d20861-serving-cert\""
Jul 03 15:42:38.148181 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.147652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"]
Jul 03 15:42:38.229044 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.229009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9938fb-5f1f-489b-be47-c0ab04206506-openshift-service-ca\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.229044 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.229049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.229281 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.229163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2pw\" (UniqueName: \"kubernetes.io/projected/0f9938fb-5f1f-489b-be47-c0ab04206506-kube-api-access-6b2pw\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.330479 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.330436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2pw\" (UniqueName: \"kubernetes.io/projected/0f9938fb-5f1f-489b-be47-c0ab04206506-kube-api-access-6b2pw\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.330647 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.330545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9938fb-5f1f-489b-be47-c0ab04206506-openshift-service-ca\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.330647 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.330566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.330739 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:42:38.330672    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-37d20861-serving-cert: secret "maas-api-e2e-mt-37d20861-serving-cert" not found
Jul 03 15:42:38.330739 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:42:38.330738    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls podName:0f9938fb-5f1f-489b-be47-c0ab04206506 nodeName:}" failed. No retries permitted until 2026-07-03 15:42:38.830716036 +0000 UTC m=+1759.304897623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls") pod "maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" (UID: "0f9938fb-5f1f-489b-be47-c0ab04206506") : secret "maas-api-e2e-mt-37d20861-serving-cert" not found
Jul 03 15:42:38.331166 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.331146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9938fb-5f1f-489b-be47-c0ab04206506-openshift-service-ca\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.341814 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.341790    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2pw\" (UniqueName: \"kubernetes.io/projected/0f9938fb-5f1f-489b-be47-c0ab04206506-kube-api-access-6b2pw\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.836056 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.836024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:38.838629 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:38.838598    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls\") pod \"maas-api-e2e-mt-37d20861-7984d8b976-cvbgq\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") " pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:39.049194 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:39.049155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:39.196954 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:39.196903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"]
Jul 03 15:42:39.203185 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:42:39.203153    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9938fb_5f1f_489b_be47_c0ab04206506.slice/crio-0950aecfe93a6d6d0f7887c786360348bd2dd39c54165d86435c6fa63a0cf40b WatchSource:0}: Error finding container 0950aecfe93a6d6d0f7887c786360348bd2dd39c54165d86435c6fa63a0cf40b: Status 404 returned error can't find the container with id 0950aecfe93a6d6d0f7887c786360348bd2dd39c54165d86435c6fa63a0cf40b
Jul 03 15:42:40.035421 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:40.035355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" event={"ID":"0f9938fb-5f1f-489b-be47-c0ab04206506","Type":"ContainerStarted","Data":"bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666"}
Jul 03 15:42:40.035635 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:40.035530    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:42:40.035635 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:40.035550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" event={"ID":"0f9938fb-5f1f-489b-be47-c0ab04206506","Type":"ContainerStarted","Data":"0950aecfe93a6d6d0f7887c786360348bd2dd39c54165d86435c6fa63a0cf40b"}
Jul 03 15:42:40.057772 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:40.057709    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" podStartSLOduration=1.742668744 podStartE2EDuration="2.057686152s" totalImagesPullingTime="315.017408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:42:40.056564609 +0000 UTC m=+1760.530746239" watchObservedRunningTime="2026-07-03 15:42:40.057686152 +0000 UTC m=+1760.531867758"
Jul 03 15:42:46.046429 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:42:46.046398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:43:20.032896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.032865    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:43:20.037382 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.037350    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:43:20.408064 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.408033    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"]
Jul 03 15:43:20.408299 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.408252    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" podUID="0f9938fb-5f1f-489b-be47-c0ab04206506" containerName="maas-api" containerID="cri-o://bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666" gracePeriod=30
Jul 03 15:43:20.664776 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.664717    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:43:20.751540 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.751512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b2pw\" (UniqueName: \"kubernetes.io/projected/0f9938fb-5f1f-489b-be47-c0ab04206506-kube-api-access-6b2pw\") pod \"0f9938fb-5f1f-489b-be47-c0ab04206506\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") "
Jul 03 15:43:20.751730 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.751632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9938fb-5f1f-489b-be47-c0ab04206506-openshift-service-ca\") pod \"0f9938fb-5f1f-489b-be47-c0ab04206506\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") "
Jul 03 15:43:20.751730 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.751679    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls\") pod \"0f9938fb-5f1f-489b-be47-c0ab04206506\" (UID: \"0f9938fb-5f1f-489b-be47-c0ab04206506\") "
Jul 03 15:43:20.752023 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.751999    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9938fb-5f1f-489b-be47-c0ab04206506-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f9938fb-5f1f-489b-be47-c0ab04206506" (UID: "0f9938fb-5f1f-489b-be47-c0ab04206506"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:43:20.753918 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.753884    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f9938fb-5f1f-489b-be47-c0ab04206506" (UID: "0f9938fb-5f1f-489b-be47-c0ab04206506"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:43:20.754050 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.753935    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9938fb-5f1f-489b-be47-c0ab04206506-kube-api-access-6b2pw" (OuterVolumeSpecName: "kube-api-access-6b2pw") pod "0f9938fb-5f1f-489b-be47-c0ab04206506" (UID: "0f9938fb-5f1f-489b-be47-c0ab04206506"). InnerVolumeSpecName "kube-api-access-6b2pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:43:20.853037 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.852993    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9938fb-5f1f-489b-be47-c0ab04206506-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:43:20.853037 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.853030    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9938fb-5f1f-489b-be47-c0ab04206506-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:43:20.853037 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:20.853044    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b2pw\" (UniqueName: \"kubernetes.io/projected/0f9938fb-5f1f-489b-be47-c0ab04206506-kube-api-access-6b2pw\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:43:21.249931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.249894    2579 generic.go:356] "Generic (PLEG): container finished" podID="0f9938fb-5f1f-489b-be47-c0ab04206506" containerID="bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666" exitCode=0
Jul 03 15:43:21.250320 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.249945    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"
Jul 03 15:43:21.250320 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.249983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" event={"ID":"0f9938fb-5f1f-489b-be47-c0ab04206506","Type":"ContainerDied","Data":"bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666"}
Jul 03 15:43:21.250320 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.250042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq" event={"ID":"0f9938fb-5f1f-489b-be47-c0ab04206506","Type":"ContainerDied","Data":"0950aecfe93a6d6d0f7887c786360348bd2dd39c54165d86435c6fa63a0cf40b"}
Jul 03 15:43:21.250320 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.250065    2579 scope.go:117] "RemoveContainer" containerID="bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666"
Jul 03 15:43:21.259767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.259750    2579 scope.go:117] "RemoveContainer" containerID="bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666"
Jul 03 15:43:21.260021 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:43:21.260001    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666\": container with ID starting with bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666 not found: ID does not exist" containerID="bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666"
Jul 03 15:43:21.260075 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.260030    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666"} err="failed to get container status \"bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666\": rpc error: code = NotFound desc = could not find container \"bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666\": container with ID starting with bd1b46e367b4b21de568e4987b803647d92ede8af2eee648f42b9fb3bc4af666 not found: ID does not exist"
Jul 03 15:43:21.271531 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.271506    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"]
Jul 03 15:43:21.275376 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:21.275342    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-37d20861-7984d8b976-cvbgq"]
Jul 03 15:43:22.010099 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:43:22.010062    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f9938fb-5f1f-489b-be47-c0ab04206506" path="/var/lib/kubelet/pods/0f9938fb-5f1f-489b-be47-c0ab04206506/volumes"
Jul 03 15:45:00.144493 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.144418    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29718225-blfdk"]
Jul 03 15:45:00.144954 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.144830    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f9938fb-5f1f-489b-be47-c0ab04206506" containerName="maas-api"
Jul 03 15:45:00.144954 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.144842    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f9938fb-5f1f-489b-be47-c0ab04206506" containerName="maas-api"
Jul 03 15:45:00.144954 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.144913    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f9938fb-5f1f-489b-be47-c0ab04206506" containerName="maas-api"
Jul 03 15:45:00.147872 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.147856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:00.155916 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.155893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718225-blfdk"]
Jul 03 15:45:00.312375 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.312312    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6fr\" (UniqueName: \"kubernetes.io/projected/b1ea2a8f-d925-4d32-9a48-8f0a16b8a459-kube-api-access-xd6fr\") pod \"maas-api-key-cleanup-29718225-blfdk\" (UID: \"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459\") " pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:00.413867 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.413775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6fr\" (UniqueName: \"kubernetes.io/projected/b1ea2a8f-d925-4d32-9a48-8f0a16b8a459-kube-api-access-xd6fr\") pod \"maas-api-key-cleanup-29718225-blfdk\" (UID: \"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459\") " pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:00.425486 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.425455    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6fr\" (UniqueName: \"kubernetes.io/projected/b1ea2a8f-d925-4d32-9a48-8f0a16b8a459-kube-api-access-xd6fr\") pod \"maas-api-key-cleanup-29718225-blfdk\" (UID: \"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459\") " pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:00.460445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.460416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:00.596254 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.596224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718225-blfdk"]
Jul 03 15:45:00.598430 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:45:00.598401    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ea2a8f_d925_4d32_9a48_8f0a16b8a459.slice/crio-efaf0f2ad60eeae9811fa3db07af3543195750f3a16f115829500b0eaa1faf76 WatchSource:0}: Error finding container efaf0f2ad60eeae9811fa3db07af3543195750f3a16f115829500b0eaa1faf76: Status 404 returned error can't find the container with id efaf0f2ad60eeae9811fa3db07af3543195750f3a16f115829500b0eaa1faf76
Jul 03 15:45:00.751608 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:00.751516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk" event={"ID":"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459","Type":"ContainerStarted","Data":"efaf0f2ad60eeae9811fa3db07af3543195750f3a16f115829500b0eaa1faf76"}
Jul 03 15:45:01.757767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:01.757674    2579 generic.go:356] "Generic (PLEG): container finished" podID="b1ea2a8f-d925-4d32-9a48-8f0a16b8a459" containerID="16f70f8ac0d232c1ec09c3b9037adb66e970a2556c568a3a2b82a0f7a827e371" exitCode=0
Jul 03 15:45:01.757767 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:01.757756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk" event={"ID":"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459","Type":"ContainerDied","Data":"16f70f8ac0d232c1ec09c3b9037adb66e970a2556c568a3a2b82a0f7a827e371"}
Jul 03 15:45:02.896808 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:02.896784    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:03.043533 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:03.043429    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd6fr\" (UniqueName: \"kubernetes.io/projected/b1ea2a8f-d925-4d32-9a48-8f0a16b8a459-kube-api-access-xd6fr\") pod \"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459\" (UID: \"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459\") "
Jul 03 15:45:03.045652 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:03.045623    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ea2a8f-d925-4d32-9a48-8f0a16b8a459-kube-api-access-xd6fr" (OuterVolumeSpecName: "kube-api-access-xd6fr") pod "b1ea2a8f-d925-4d32-9a48-8f0a16b8a459" (UID: "b1ea2a8f-d925-4d32-9a48-8f0a16b8a459"). InnerVolumeSpecName "kube-api-access-xd6fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:45:03.145543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:03.145512    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd6fr\" (UniqueName: \"kubernetes.io/projected/b1ea2a8f-d925-4d32-9a48-8f0a16b8a459-kube-api-access-xd6fr\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:45:03.770568 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:03.770540    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk"
Jul 03 15:45:03.770568 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:03.770541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718225-blfdk" event={"ID":"b1ea2a8f-d925-4d32-9a48-8f0a16b8a459","Type":"ContainerDied","Data":"efaf0f2ad60eeae9811fa3db07af3543195750f3a16f115829500b0eaa1faf76"}
Jul 03 15:45:03.770801 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:03.770627    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efaf0f2ad60eeae9811fa3db07af3543195750f3a16f115829500b0eaa1faf76"
Jul 03 15:45:12.862333 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.862303    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"]
Jul 03 15:45:12.862818 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.862789    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ea2a8f-d925-4d32-9a48-8f0a16b8a459" containerName="cleanup"
Jul 03 15:45:12.862818 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.862804    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ea2a8f-d925-4d32-9a48-8f0a16b8a459" containerName="cleanup"
Jul 03 15:45:12.862945 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.862894    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ea2a8f-d925-4d32-9a48-8f0a16b8a459" containerName="cleanup"
Jul 03 15:45:12.866120 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.866098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:12.869138 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.869111    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-33bce5-serving-cert\""
Jul 03 15:45:12.876337 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.876312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"]
Jul 03 15:45:12.944378 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.944332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26cj\" (UniqueName: \"kubernetes.io/projected/a52e2010-21e6-4ccc-acdf-14969d11fab7-kube-api-access-k26cj\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:12.944587 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.944493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:12.944587 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:12.944540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a52e2010-21e6-4ccc-acdf-14969d11fab7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.045589 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.045554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.045589 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.045594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a52e2010-21e6-4ccc-acdf-14969d11fab7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.045851 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.045671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26cj\" (UniqueName: \"kubernetes.io/projected/a52e2010-21e6-4ccc-acdf-14969d11fab7-kube-api-access-k26cj\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.045851 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:45:13.045691    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-33bce5-serving-cert: secret "maas-api-e2e-inf-a-33bce5-serving-cert" not found
Jul 03 15:45:13.045851 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:45:13.045769    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls podName:a52e2010-21e6-4ccc-acdf-14969d11fab7 nodeName:}" failed. No retries permitted until 2026-07-03 15:45:13.545745856 +0000 UTC m=+1914.019927438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls") pod "maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" (UID: "a52e2010-21e6-4ccc-acdf-14969d11fab7") : secret "maas-api-e2e-inf-a-33bce5-serving-cert" not found
Jul 03 15:45:13.046338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.046314    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a52e2010-21e6-4ccc-acdf-14969d11fab7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.057356 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.057327    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26cj\" (UniqueName: \"kubernetes.io/projected/a52e2010-21e6-4ccc-acdf-14969d11fab7-kube-api-access-k26cj\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.550637 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.550597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.553127 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.553107    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls\") pod \"maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") " pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.777199 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.777164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:13.918855 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.918830    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"]
Jul 03 15:45:13.921343 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:45:13.921307    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52e2010_21e6_4ccc_acdf_14969d11fab7.slice/crio-63e984acddb7f6286958f7976e2c7ff6264c92665cb04d92385ac5ff87f38bd7 WatchSource:0}: Error finding container 63e984acddb7f6286958f7976e2c7ff6264c92665cb04d92385ac5ff87f38bd7: Status 404 returned error can't find the container with id 63e984acddb7f6286958f7976e2c7ff6264c92665cb04d92385ac5ff87f38bd7
Jul 03 15:45:13.923114 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:13.923088    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 15:45:14.829107 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:14.829008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" event={"ID":"a52e2010-21e6-4ccc-acdf-14969d11fab7","Type":"ContainerStarted","Data":"cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c"}
Jul 03 15:45:14.829107 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:14.829068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" event={"ID":"a52e2010-21e6-4ccc-acdf-14969d11fab7","Type":"ContainerStarted","Data":"63e984acddb7f6286958f7976e2c7ff6264c92665cb04d92385ac5ff87f38bd7"}
Jul 03 15:45:14.829107 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:14.829093    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:14.847282 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:14.847230    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" podStartSLOduration=2.387711883 podStartE2EDuration="2.847210415s" totalImagesPullingTime="459.498532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:45:14.847065042 +0000 UTC m=+1915.321246645" watchObservedRunningTime="2026-07-03 15:45:14.847210415 +0000 UTC m=+1915.321392020"
Jul 03 15:45:20.839144 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:20.839111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:45:21.879697 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:21.879663    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"]
Jul 03 15:45:21.883188 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:21.883168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:21.886955 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:21.886928    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-59ce5a-serving-cert\""
Jul 03 15:45:21.893733 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:21.893681    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"]
Jul 03 15:45:22.033515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.033477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndl5h\" (UniqueName: \"kubernetes.io/projected/1e09c957-d701-4501-a556-34fb3fc9467e-kube-api-access-ndl5h\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.033685 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.033538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e09c957-d701-4501-a556-34fb3fc9467e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.033685 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.033649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e09c957-d701-4501-a556-34fb3fc9467e-maas-api-tls\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.134684 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.134599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e09c957-d701-4501-a556-34fb3fc9467e-maas-api-tls\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.134684 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.134668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndl5h\" (UniqueName: \"kubernetes.io/projected/1e09c957-d701-4501-a556-34fb3fc9467e-kube-api-access-ndl5h\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.134903 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.134712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e09c957-d701-4501-a556-34fb3fc9467e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.135393 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.135337    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e09c957-d701-4501-a556-34fb3fc9467e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.137232 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.137208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e09c957-d701-4501-a556-34fb3fc9467e-maas-api-tls\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.144293 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.144270    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndl5h\" (UniqueName: \"kubernetes.io/projected/1e09c957-d701-4501-a556-34fb3fc9467e-kube-api-access-ndl5h\") pod \"maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") " pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.196989 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.196959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.345353 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.345322    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"]
Jul 03 15:45:22.346720 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:45:22.346693    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e09c957_d701_4501_a556_34fb3fc9467e.slice/crio-7352ba72fdda6104c1150c299920fc21fbfc65255cb51e43eb3e94dde91bd896 WatchSource:0}: Error finding container 7352ba72fdda6104c1150c299920fc21fbfc65255cb51e43eb3e94dde91bd896: Status 404 returned error can't find the container with id 7352ba72fdda6104c1150c299920fc21fbfc65255cb51e43eb3e94dde91bd896
Jul 03 15:45:22.874500 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.874461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q" event={"ID":"1e09c957-d701-4501-a556-34fb3fc9467e","Type":"ContainerStarted","Data":"6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43"}
Jul 03 15:45:22.874642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.874513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q" event={"ID":"1e09c957-d701-4501-a556-34fb3fc9467e","Type":"ContainerStarted","Data":"7352ba72fdda6104c1150c299920fc21fbfc65255cb51e43eb3e94dde91bd896"}
Jul 03 15:45:22.874642 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.874585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:45:22.901814 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:22.901730    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q" podStartSLOduration=1.589713922 podStartE2EDuration="1.901711062s" totalImagesPullingTime="311.99714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:45:22.900430217 +0000 UTC m=+1923.374611823" watchObservedRunningTime="2026-07-03 15:45:22.901711062 +0000 UTC m=+1923.375892687"
Jul 03 15:45:28.884452 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:45:28.884420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:46:42.654875 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:42.654838    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"]
Jul 03 15:46:42.656043 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:42.655992    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" podUID="a52e2010-21e6-4ccc-acdf-14969d11fab7" containerName="maas-api" containerID="cri-o://cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c" gracePeriod=30
Jul 03 15:46:42.915735 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:42.915672    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:46:43.043634 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.043599    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls\") pod \"a52e2010-21e6-4ccc-acdf-14969d11fab7\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") "
Jul 03 15:46:43.043813 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.043695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k26cj\" (UniqueName: \"kubernetes.io/projected/a52e2010-21e6-4ccc-acdf-14969d11fab7-kube-api-access-k26cj\") pod \"a52e2010-21e6-4ccc-acdf-14969d11fab7\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") "
Jul 03 15:46:43.043813 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.043755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a52e2010-21e6-4ccc-acdf-14969d11fab7-openshift-service-ca\") pod \"a52e2010-21e6-4ccc-acdf-14969d11fab7\" (UID: \"a52e2010-21e6-4ccc-acdf-14969d11fab7\") "
Jul 03 15:46:43.044149 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.044121    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a52e2010-21e6-4ccc-acdf-14969d11fab7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a52e2010-21e6-4ccc-acdf-14969d11fab7" (UID: "a52e2010-21e6-4ccc-acdf-14969d11fab7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:46:43.045864 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.045841    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a52e2010-21e6-4ccc-acdf-14969d11fab7" (UID: "a52e2010-21e6-4ccc-acdf-14969d11fab7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:46:43.045936 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.045846    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52e2010-21e6-4ccc-acdf-14969d11fab7-kube-api-access-k26cj" (OuterVolumeSpecName: "kube-api-access-k26cj") pod "a52e2010-21e6-4ccc-acdf-14969d11fab7" (UID: "a52e2010-21e6-4ccc-acdf-14969d11fab7"). InnerVolumeSpecName "kube-api-access-k26cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:46:43.145564 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.145531    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a52e2010-21e6-4ccc-acdf-14969d11fab7-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:46:43.145564 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.145565    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k26cj\" (UniqueName: \"kubernetes.io/projected/a52e2010-21e6-4ccc-acdf-14969d11fab7-kube-api-access-k26cj\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:46:43.145778 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.145582    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a52e2010-21e6-4ccc-acdf-14969d11fab7-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:46:43.292445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.292326    2579 generic.go:356] "Generic (PLEG): container finished" podID="a52e2010-21e6-4ccc-acdf-14969d11fab7" containerID="cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c" exitCode=0
Jul 03 15:46:43.292445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.292406    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"
Jul 03 15:46:43.292445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.292412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" event={"ID":"a52e2010-21e6-4ccc-acdf-14969d11fab7","Type":"ContainerDied","Data":"cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c"}
Jul 03 15:46:43.292723 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.292480    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt" event={"ID":"a52e2010-21e6-4ccc-acdf-14969d11fab7","Type":"ContainerDied","Data":"63e984acddb7f6286958f7976e2c7ff6264c92665cb04d92385ac5ff87f38bd7"}
Jul 03 15:46:43.292723 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.292503    2579 scope.go:117] "RemoveContainer" containerID="cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c"
Jul 03 15:46:43.301758 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.301742    2579 scope.go:117] "RemoveContainer" containerID="cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c"
Jul 03 15:46:43.302020 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:46:43.302001    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c\": container with ID starting with cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c not found: ID does not exist" containerID="cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c"
Jul 03 15:46:43.302085 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.302029    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c"} err="failed to get container status \"cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c\": rpc error: code = NotFound desc = could not find container \"cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c\": container with ID starting with cc93bf9247dcbdcc89662cc952fdd69b97b6027a348bc6f9327bcbd4e2d5ff2c not found: ID does not exist"
Jul 03 15:46:43.314610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.314581    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"]
Jul 03 15:46:43.318860 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:43.318840    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-33bce5-dd45545dd-tthnt"]
Jul 03 15:46:44.010698 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:46:44.010665    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52e2010-21e6-4ccc-acdf-14969d11fab7" path="/var/lib/kubelet/pods/a52e2010-21e6-4ccc-acdf-14969d11fab7/volumes"
Jul 03 15:47:25.614393 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:25.614340    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"]
Jul 03 15:47:25.615222 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:25.615173    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q" podUID="1e09c957-d701-4501-a556-34fb3fc9467e" containerName="maas-api" containerID="cri-o://6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43" gracePeriod=30
Jul 03 15:47:26.072216 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.072190    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:47:26.168313 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.168217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e09c957-d701-4501-a556-34fb3fc9467e-openshift-service-ca\") pod \"1e09c957-d701-4501-a556-34fb3fc9467e\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") "
Jul 03 15:47:26.168514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.168388    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e09c957-d701-4501-a556-34fb3fc9467e-maas-api-tls\") pod \"1e09c957-d701-4501-a556-34fb3fc9467e\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") "
Jul 03 15:47:26.168514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.168431    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndl5h\" (UniqueName: \"kubernetes.io/projected/1e09c957-d701-4501-a556-34fb3fc9467e-kube-api-access-ndl5h\") pod \"1e09c957-d701-4501-a556-34fb3fc9467e\" (UID: \"1e09c957-d701-4501-a556-34fb3fc9467e\") "
Jul 03 15:47:26.168718 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.168695    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e09c957-d701-4501-a556-34fb3fc9467e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e09c957-d701-4501-a556-34fb3fc9467e" (UID: "1e09c957-d701-4501-a556-34fb3fc9467e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:47:26.168856 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.168839    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e09c957-d701-4501-a556-34fb3fc9467e-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:47:26.170684 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.170653    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e09c957-d701-4501-a556-34fb3fc9467e-kube-api-access-ndl5h" (OuterVolumeSpecName: "kube-api-access-ndl5h") pod "1e09c957-d701-4501-a556-34fb3fc9467e" (UID: "1e09c957-d701-4501-a556-34fb3fc9467e"). InnerVolumeSpecName "kube-api-access-ndl5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:47:26.170814 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.170697    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e09c957-d701-4501-a556-34fb3fc9467e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e09c957-d701-4501-a556-34fb3fc9467e" (UID: "1e09c957-d701-4501-a556-34fb3fc9467e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:47:26.270279 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.270242    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e09c957-d701-4501-a556-34fb3fc9467e-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:47:26.270279 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.270276    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndl5h\" (UniqueName: \"kubernetes.io/projected/1e09c957-d701-4501-a556-34fb3fc9467e-kube-api-access-ndl5h\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:47:26.519146 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.519052    2579 generic.go:356] "Generic (PLEG): container finished" podID="1e09c957-d701-4501-a556-34fb3fc9467e" containerID="6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43" exitCode=0
Jul 03 15:47:26.519146 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.519101    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"
Jul 03 15:47:26.519340 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.519139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q" event={"ID":"1e09c957-d701-4501-a556-34fb3fc9467e","Type":"ContainerDied","Data":"6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43"}
Jul 03 15:47:26.519340 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.519197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q" event={"ID":"1e09c957-d701-4501-a556-34fb3fc9467e","Type":"ContainerDied","Data":"7352ba72fdda6104c1150c299920fc21fbfc65255cb51e43eb3e94dde91bd896"}
Jul 03 15:47:26.519340 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.519220    2579 scope.go:117] "RemoveContainer" containerID="6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43"
Jul 03 15:47:26.528571 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.528553    2579 scope.go:117] "RemoveContainer" containerID="6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43"
Jul 03 15:47:26.528841 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:47:26.528819    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43\": container with ID starting with 6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43 not found: ID does not exist" containerID="6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43"
Jul 03 15:47:26.528909 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.528855    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43"} err="failed to get container status \"6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43\": rpc error: code = NotFound desc = could not find container \"6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43\": container with ID starting with 6e557d1e3f26d052e16ec0796efbbf5b2503738b86a869ab1cf9869de32b1c43 not found: ID does not exist"
Jul 03 15:47:26.548917 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.548863    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"]
Jul 03 15:47:26.549118 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:26.548938    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-59ce5a-745fb67976-gwl8q"]
Jul 03 15:47:28.010765 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:28.010728    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e09c957-d701-4501-a556-34fb3fc9467e" path="/var/lib/kubelet/pods/1e09c957-d701-4501-a556-34fb3fc9467e/volumes"
Jul 03 15:47:35.660511 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.660479    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"]
Jul 03 15:47:35.661126 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.661078    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e09c957-d701-4501-a556-34fb3fc9467e" containerName="maas-api"
Jul 03 15:47:35.661126 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.661101    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e09c957-d701-4501-a556-34fb3fc9467e" containerName="maas-api"
Jul 03 15:47:35.661126 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.661117    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a52e2010-21e6-4ccc-acdf-14969d11fab7" containerName="maas-api"
Jul 03 15:47:35.661126 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.661126    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a52e2010-21e6-4ccc-acdf-14969d11fab7" containerName="maas-api"
Jul 03 15:47:35.661445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.661226    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a52e2010-21e6-4ccc-acdf-14969d11fab7" containerName="maas-api"
Jul 03 15:47:35.661445 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.661243    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e09c957-d701-4501-a556-34fb3fc9467e" containerName="maas-api"
Jul 03 15:47:35.665749 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.665729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.668749 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.668727    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-354253-serving-cert\""
Jul 03 15:47:35.673927 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.673891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"]
Jul 03 15:47:35.767060 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.767020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-openshift-service-ca\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.767253 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.767180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cpdg\" (UniqueName: \"kubernetes.io/projected/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-kube-api-access-6cpdg\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.767253 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.767213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-maas-api-tls\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.867897 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.867856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cpdg\" (UniqueName: \"kubernetes.io/projected/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-kube-api-access-6cpdg\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.867897 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.867906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-maas-api-tls\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.868141 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.867941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-openshift-service-ca\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.868622 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.868599    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-openshift-service-ca\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.870661 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.870633    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-maas-api-tls\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.877401 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.877342    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cpdg\" (UniqueName: \"kubernetes.io/projected/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-kube-api-access-6cpdg\") pod \"maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") " pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:35.978750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:35.978644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:36.128195 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:36.128167    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"]
Jul 03 15:47:36.130990 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:47:36.130962    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34c4f36_9c01_4cfe_b169_131e8b1ce6f9.slice/crio-3618af5434842ef56fec2def2f2602297e8f3ea5700e803695116b5212ee5133 WatchSource:0}: Error finding container 3618af5434842ef56fec2def2f2602297e8f3ea5700e803695116b5212ee5133: Status 404 returned error can't find the container with id 3618af5434842ef56fec2def2f2602297e8f3ea5700e803695116b5212ee5133
Jul 03 15:47:36.576961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:36.576920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v" event={"ID":"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9","Type":"ContainerStarted","Data":"3618af5434842ef56fec2def2f2602297e8f3ea5700e803695116b5212ee5133"}
Jul 03 15:47:37.584018 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:37.583977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v" event={"ID":"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9","Type":"ContainerStarted","Data":"a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e"}
Jul 03 15:47:37.584443 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:37.584055    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:37.603508 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:37.603451    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v" podStartSLOduration=1.974285848 podStartE2EDuration="2.603433066s" totalImagesPullingTime="629.147218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:47:37.602204236 +0000 UTC m=+2058.076385841" watchObservedRunningTime="2026-07-03 15:47:37.603433066 +0000 UTC m=+2058.077614670"
Jul 03 15:47:43.595012 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.594930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:43.622610 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.622575    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"]
Jul 03 15:47:43.626566 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.626540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.629463 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.629440    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-959db1-serving-cert\""
Jul 03 15:47:43.641474 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.641447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"]
Jul 03 15:47:43.745668 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.745629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdng\" (UniqueName: \"kubernetes.io/projected/48b9af01-7e06-49fa-8a89-51ef6071cfee-kube-api-access-rvdng\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.745864 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.745699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b9af01-7e06-49fa-8a89-51ef6071cfee-openshift-service-ca\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.745864 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.745783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.846596 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.846513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.846750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.846610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdng\" (UniqueName: \"kubernetes.io/projected/48b9af01-7e06-49fa-8a89-51ef6071cfee-kube-api-access-rvdng\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.846750 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.846647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b9af01-7e06-49fa-8a89-51ef6071cfee-openshift-service-ca\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.846750 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:47:43.846649    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-959db1-serving-cert: secret "maas-api-e2e-api-b-959db1-serving-cert" not found
Jul 03 15:47:43.846750 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:47:43.846710    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls podName:48b9af01-7e06-49fa-8a89-51ef6071cfee nodeName:}" failed. No retries permitted until 2026-07-03 15:47:44.34668894 +0000 UTC m=+2064.820870524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls") pod "maas-api-e2e-api-b-959db1-5765df68df-cbzd4" (UID: "48b9af01-7e06-49fa-8a89-51ef6071cfee") : secret "maas-api-e2e-api-b-959db1-serving-cert" not found
Jul 03 15:47:43.847251 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.847226    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b9af01-7e06-49fa-8a89-51ef6071cfee-openshift-service-ca\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:43.857488 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:43.857467    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdng\" (UniqueName: \"kubernetes.io/projected/48b9af01-7e06-49fa-8a89-51ef6071cfee-kube-api-access-rvdng\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:44.351645 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:44.351605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:44.354247 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:44.354225    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls\") pod \"maas-api-e2e-api-b-959db1-5765df68df-cbzd4\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") " pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:44.542320 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:44.542285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:44.691475 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:44.691446    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"]
Jul 03 15:47:44.693533 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:47:44.693495    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b9af01_7e06_49fa_8a89_51ef6071cfee.slice/crio-04cd9a815f0d4b4d6f97c1fa6b1ecb32b8190e5abb3309bd2336c832c0ae814f WatchSource:0}: Error finding container 04cd9a815f0d4b4d6f97c1fa6b1ecb32b8190e5abb3309bd2336c832c0ae814f: Status 404 returned error can't find the container with id 04cd9a815f0d4b4d6f97c1fa6b1ecb32b8190e5abb3309bd2336c832c0ae814f
Jul 03 15:47:45.637726 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:45.637690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4" event={"ID":"48b9af01-7e06-49fa-8a89-51ef6071cfee","Type":"ContainerStarted","Data":"3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01"}
Jul 03 15:47:45.637916 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:45.637749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4" event={"ID":"48b9af01-7e06-49fa-8a89-51ef6071cfee","Type":"ContainerStarted","Data":"04cd9a815f0d4b4d6f97c1fa6b1ecb32b8190e5abb3309bd2336c832c0ae814f"}
Jul 03 15:47:45.637916 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:45.637795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:45.679703 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:45.679652    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4" podStartSLOduration=2.359754392 podStartE2EDuration="2.679636394s" totalImagesPullingTime="319.882002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:47:45.678052712 +0000 UTC m=+2066.152234317" watchObservedRunningTime="2026-07-03 15:47:45.679636394 +0000 UTC m=+2066.153818010"
Jul 03 15:47:51.648616 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:51.648587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:47:56.834381 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:56.834323    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"]
Jul 03 15:47:56.835023 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:56.834969    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v" podUID="b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" containerName="maas-api" containerID="cri-o://a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e" gracePeriod=30
Jul 03 15:47:56.875880 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:47:56.875838    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34c4f36_9c01_4cfe_b169_131e8b1ce6f9.slice/crio-conmon-a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34c4f36_9c01_4cfe_b169_131e8b1ce6f9.slice/crio-a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e.scope\": RecentStats: unable to find data in memory cache]"
Jul 03 15:47:57.094989 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.094965    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:57.182213 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.182179    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-maas-api-tls\") pod \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") "
Jul 03 15:47:57.182437 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.182282    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-openshift-service-ca\") pod \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") "
Jul 03 15:47:57.182437 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.182335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cpdg\" (UniqueName: \"kubernetes.io/projected/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-kube-api-access-6cpdg\") pod \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\" (UID: \"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9\") "
Jul 03 15:47:57.182744 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.182703    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" (UID: "b34c4f36-9c01-4cfe-b169-131e8b1ce6f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:47:57.184644 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.184613    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" (UID: "b34c4f36-9c01-4cfe-b169-131e8b1ce6f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:47:57.184736 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.184663    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-kube-api-access-6cpdg" (OuterVolumeSpecName: "kube-api-access-6cpdg") pod "b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" (UID: "b34c4f36-9c01-4cfe-b169-131e8b1ce6f9"). InnerVolumeSpecName "kube-api-access-6cpdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:47:57.283858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.283813    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:47:57.283858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.283850    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cpdg\" (UniqueName: \"kubernetes.io/projected/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-kube-api-access-6cpdg\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:47:57.283858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.283860    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:47:57.699009 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.698973    2579 generic.go:356] "Generic (PLEG): container finished" podID="b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" containerID="a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e" exitCode=0
Jul 03 15:47:57.699191 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.699021    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"
Jul 03 15:47:57.699191 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.699056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v" event={"ID":"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9","Type":"ContainerDied","Data":"a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e"}
Jul 03 15:47:57.699191 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.699112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v" event={"ID":"b34c4f36-9c01-4cfe-b169-131e8b1ce6f9","Type":"ContainerDied","Data":"3618af5434842ef56fec2def2f2602297e8f3ea5700e803695116b5212ee5133"}
Jul 03 15:47:57.699191 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.699136    2579 scope.go:117] "RemoveContainer" containerID="a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e"
Jul 03 15:47:57.709425 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.709354    2579 scope.go:117] "RemoveContainer" containerID="a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e"
Jul 03 15:47:57.709728 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:47:57.709702    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e\": container with ID starting with a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e not found: ID does not exist" containerID="a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e"
Jul 03 15:47:57.709806 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.709737    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e"} err="failed to get container status \"a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e\": rpc error: code = NotFound desc = could not find container \"a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e\": container with ID starting with a65990e964a5a6dbe610f904fe3a92a3fba866251242fb8b3c4d45856065721e not found: ID does not exist"
Jul 03 15:47:57.723108 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.723076    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"]
Jul 03 15:47:57.727049 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:57.727021    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-354253-6ffb4d75bd-6n62v"]
Jul 03 15:47:58.011042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:47:58.010942    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" path="/var/lib/kubelet/pods/b34c4f36-9c01-4cfe-b169-131e8b1ce6f9/volumes"
Jul 03 15:48:04.081494 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.081448    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"]
Jul 03 15:48:04.081900 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.081720    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4" podUID="48b9af01-7e06-49fa-8a89-51ef6071cfee" containerName="maas-api" containerID="cri-o://3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01" gracePeriod=30
Jul 03 15:48:04.347303 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.347276    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:48:04.455009 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.454972    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvdng\" (UniqueName: \"kubernetes.io/projected/48b9af01-7e06-49fa-8a89-51ef6071cfee-kube-api-access-rvdng\") pod \"48b9af01-7e06-49fa-8a89-51ef6071cfee\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") "
Jul 03 15:48:04.455009 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.455015    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls\") pod \"48b9af01-7e06-49fa-8a89-51ef6071cfee\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") "
Jul 03 15:48:04.455280 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.455077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b9af01-7e06-49fa-8a89-51ef6071cfee-openshift-service-ca\") pod \"48b9af01-7e06-49fa-8a89-51ef6071cfee\" (UID: \"48b9af01-7e06-49fa-8a89-51ef6071cfee\") "
Jul 03 15:48:04.455566 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.455535    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b9af01-7e06-49fa-8a89-51ef6071cfee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48b9af01-7e06-49fa-8a89-51ef6071cfee" (UID: "48b9af01-7e06-49fa-8a89-51ef6071cfee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:48:04.457380 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.457330    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48b9af01-7e06-49fa-8a89-51ef6071cfee" (UID: "48b9af01-7e06-49fa-8a89-51ef6071cfee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:48:04.457522 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.457428    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b9af01-7e06-49fa-8a89-51ef6071cfee-kube-api-access-rvdng" (OuterVolumeSpecName: "kube-api-access-rvdng") pod "48b9af01-7e06-49fa-8a89-51ef6071cfee" (UID: "48b9af01-7e06-49fa-8a89-51ef6071cfee"). InnerVolumeSpecName "kube-api-access-rvdng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:48:04.556515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.556476    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvdng\" (UniqueName: \"kubernetes.io/projected/48b9af01-7e06-49fa-8a89-51ef6071cfee-kube-api-access-rvdng\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:48:04.556515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.556509    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48b9af01-7e06-49fa-8a89-51ef6071cfee-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:48:04.556515 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.556519    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48b9af01-7e06-49fa-8a89-51ef6071cfee-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:48:04.740401 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.740283    2579 generic.go:356] "Generic (PLEG): container finished" podID="48b9af01-7e06-49fa-8a89-51ef6071cfee" containerID="3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01" exitCode=0
Jul 03 15:48:04.740401 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.740339    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"
Jul 03 15:48:04.740588 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.740391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4" event={"ID":"48b9af01-7e06-49fa-8a89-51ef6071cfee","Type":"ContainerDied","Data":"3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01"}
Jul 03 15:48:04.740588 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.740460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4" event={"ID":"48b9af01-7e06-49fa-8a89-51ef6071cfee","Type":"ContainerDied","Data":"04cd9a815f0d4b4d6f97c1fa6b1ecb32b8190e5abb3309bd2336c832c0ae814f"}
Jul 03 15:48:04.740588 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.740485    2579 scope.go:117] "RemoveContainer" containerID="3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01"
Jul 03 15:48:04.750613 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.750590    2579 scope.go:117] "RemoveContainer" containerID="3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01"
Jul 03 15:48:04.750902 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:48:04.750883    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01\": container with ID starting with 3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01 not found: ID does not exist" containerID="3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01"
Jul 03 15:48:04.750980 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.750916    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01"} err="failed to get container status \"3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01\": rpc error: code = NotFound desc = could not find container \"3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01\": container with ID starting with 3bdb0aec8856757bc4229a49a02d7cae3fa55110b41146e52eb5a715fe95dd01 not found: ID does not exist"
Jul 03 15:48:04.763521 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.763485    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"]
Jul 03 15:48:04.767029 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:04.767003    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-959db1-5765df68df-cbzd4"]
Jul 03 15:48:06.010979 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:06.010946    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b9af01-7e06-49fa-8a89-51ef6071cfee" path="/var/lib/kubelet/pods/48b9af01-7e06-49fa-8a89-51ef6071cfee/volumes"
Jul 03 15:48:13.947896 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.947859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"]
Jul 03 15:48:13.948329 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.948313    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b9af01-7e06-49fa-8a89-51ef6071cfee" containerName="maas-api"
Jul 03 15:48:13.948329 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.948329    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b9af01-7e06-49fa-8a89-51ef6071cfee" containerName="maas-api"
Jul 03 15:48:13.948493 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.948399    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" containerName="maas-api"
Jul 03 15:48:13.948493 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.948406    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" containerName="maas-api"
Jul 03 15:48:13.948493 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.948483    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b34c4f36-9c01-4cfe-b169-131e8b1ce6f9" containerName="maas-api"
Jul 03 15:48:13.948493 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.948491    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b9af01-7e06-49fa-8a89-51ef6071cfee" containerName="maas-api"
Jul 03 15:48:13.953029 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.953007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:13.956134 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.956107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-3703d4-serving-cert\""
Jul 03 15:48:13.972834 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:13.972802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"]
Jul 03 15:48:14.048715 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.048680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.048906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.048801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a522a93-a07e-40fd-b04b-114552722a48-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.048906 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.048889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjx6\" (UniqueName: \"kubernetes.io/projected/8a522a93-a07e-40fd-b04b-114552722a48-kube-api-access-kxjx6\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.150442 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.150396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a522a93-a07e-40fd-b04b-114552722a48-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.150653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.150511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjx6\" (UniqueName: \"kubernetes.io/projected/8a522a93-a07e-40fd-b04b-114552722a48-kube-api-access-kxjx6\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.150653 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.150568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.150784 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:48:14.150714    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-3703d4-serving-cert: secret "maas-api-e2e-shared-a-3703d4-serving-cert" not found
Jul 03 15:48:14.150836 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:48:14.150797    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls podName:8a522a93-a07e-40fd-b04b-114552722a48 nodeName:}" failed. No retries permitted until 2026-07-03 15:48:14.650775869 +0000 UTC m=+2095.124957471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls") pod "maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" (UID: "8a522a93-a07e-40fd-b04b-114552722a48") : secret "maas-api-e2e-shared-a-3703d4-serving-cert" not found
Jul 03 15:48:14.151195 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.151172    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a522a93-a07e-40fd-b04b-114552722a48-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.162603 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.162568    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjx6\" (UniqueName: \"kubernetes.io/projected/8a522a93-a07e-40fd-b04b-114552722a48-kube-api-access-kxjx6\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.657127 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.657083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.659755 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.659722    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls\") pod \"maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") " pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:14.863263 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:14.863222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:15.012466 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:15.012436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"]
Jul 03 15:48:15.014892 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:48:15.014864    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a522a93_a07e_40fd_b04b_114552722a48.slice/crio-7535aa101b4646a58c110a9d453447867d9757de15d0c9575c8afec452edf6e6 WatchSource:0}: Error finding container 7535aa101b4646a58c110a9d453447867d9757de15d0c9575c8afec452edf6e6: Status 404 returned error can't find the container with id 7535aa101b4646a58c110a9d453447867d9757de15d0c9575c8afec452edf6e6
Jul 03 15:48:15.809510 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:15.809415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" event={"ID":"8a522a93-a07e-40fd-b04b-114552722a48","Type":"ContainerStarted","Data":"2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c"}
Jul 03 15:48:15.809510 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:15.809481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" event={"ID":"8a522a93-a07e-40fd-b04b-114552722a48","Type":"ContainerStarted","Data":"7535aa101b4646a58c110a9d453447867d9757de15d0c9575c8afec452edf6e6"}
Jul 03 15:48:15.809724 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:15.809622    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:15.834246 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:15.834189    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" podStartSLOduration=2.34911082 podStartE2EDuration="2.834169788s" totalImagesPullingTime="485.058968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:48:15.830871213 +0000 UTC m=+2096.305052819" watchObservedRunningTime="2026-07-03 15:48:15.834169788 +0000 UTC m=+2096.308351409"
Jul 03 15:48:20.066743 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:20.066696    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:48:20.072858 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:20.072835    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:48:21.820494 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:21.820461    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:48:27.053010 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.052973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"]
Jul 03 15:48:27.056908 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.056885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.059748 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.059721    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-31658c-serving-cert\""
Jul 03 15:48:27.066639 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.066613    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"]
Jul 03 15:48:27.178049 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.177997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e009d460-8478-4f9d-a087-9dff03f00831-openshift-service-ca\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.178268 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.178152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.178268 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.178259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvtdr\" (UniqueName: \"kubernetes.io/projected/e009d460-8478-4f9d-a087-9dff03f00831-kube-api-access-pvtdr\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.279251 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.279208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvtdr\" (UniqueName: \"kubernetes.io/projected/e009d460-8478-4f9d-a087-9dff03f00831-kube-api-access-pvtdr\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.279488 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.279273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e009d460-8478-4f9d-a087-9dff03f00831-openshift-service-ca\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.279488 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.279313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.279488 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:48:27.279448    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-31658c-serving-cert: secret "maas-api-e2e-shared-b-31658c-serving-cert" not found
Jul 03 15:48:27.279679 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:48:27.279526    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls podName:e009d460-8478-4f9d-a087-9dff03f00831 nodeName:}" failed. No retries permitted until 2026-07-03 15:48:27.779510012 +0000 UTC m=+2108.253691594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls") pod "maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" (UID: "e009d460-8478-4f9d-a087-9dff03f00831") : secret "maas-api-e2e-shared-b-31658c-serving-cert" not found
Jul 03 15:48:27.280056 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.280028    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e009d460-8478-4f9d-a087-9dff03f00831-openshift-service-ca\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.292147 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.292113    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvtdr\" (UniqueName: \"kubernetes.io/projected/e009d460-8478-4f9d-a087-9dff03f00831-kube-api-access-pvtdr\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.783388 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.783328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.786323 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.786289    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls\") pod \"maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") " pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:27.970112 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:27.970065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:28.120877 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:28.120851    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"]
Jul 03 15:48:28.123656 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:48:28.123618    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode009d460_8478_4f9d_a087_9dff03f00831.slice/crio-dab8a8dcf9884cea3af0aff15651214463b34d038d54b6a3e9fcb19075fecc69 WatchSource:0}: Error finding container dab8a8dcf9884cea3af0aff15651214463b34d038d54b6a3e9fcb19075fecc69: Status 404 returned error can't find the container with id dab8a8dcf9884cea3af0aff15651214463b34d038d54b6a3e9fcb19075fecc69
Jul 03 15:48:28.884791 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:28.884756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" event={"ID":"e009d460-8478-4f9d-a087-9dff03f00831","Type":"ContainerStarted","Data":"5bb885896a4405503741f54de0d92877deb79d215c1bec177e760ad8a6b7672a"}
Jul 03 15:48:28.884967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:28.884809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" event={"ID":"e009d460-8478-4f9d-a087-9dff03f00831","Type":"ContainerStarted","Data":"dab8a8dcf9884cea3af0aff15651214463b34d038d54b6a3e9fcb19075fecc69"}
Jul 03 15:48:28.884967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:28.884844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:48:28.907394 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:28.906543    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" podStartSLOduration=1.559053908 podStartE2EDuration="1.906509552s" totalImagesPullingTime="347.455644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 15:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:48:28.902805687 +0000 UTC m=+2109.376987294" watchObservedRunningTime="2026-07-03 15:48:28.906509552 +0000 UTC m=+2109.380691158"
Jul 03 15:48:34.896062 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:48:34.896023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:53:20.105889 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:53:20.105855    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:53:20.114825 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:53:20.114795    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-glj6t_08a5e94c-b2c1-46b9-89e7-715a6cdcf4b0/ovn-acl-logging/0.log"
Jul 03 15:54:22.852322 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:22.852277    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"]
Jul 03 15:54:22.852938 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:22.852639    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" podUID="8a522a93-a07e-40fd-b04b-114552722a48" containerName="maas-api" containerID="cri-o://2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c" gracePeriod=30
Jul 03 15:54:23.119764 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.119738    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:54:23.158501 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.158471    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxjx6\" (UniqueName: \"kubernetes.io/projected/8a522a93-a07e-40fd-b04b-114552722a48-kube-api-access-kxjx6\") pod \"8a522a93-a07e-40fd-b04b-114552722a48\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") "
Jul 03 15:54:23.158699 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.158519    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a522a93-a07e-40fd-b04b-114552722a48-openshift-service-ca\") pod \"8a522a93-a07e-40fd-b04b-114552722a48\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") "
Jul 03 15:54:23.158699 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.158558    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls\") pod \"8a522a93-a07e-40fd-b04b-114552722a48\" (UID: \"8a522a93-a07e-40fd-b04b-114552722a48\") "
Jul 03 15:54:23.158941 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.158909    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a522a93-a07e-40fd-b04b-114552722a48-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a522a93-a07e-40fd-b04b-114552722a48" (UID: "8a522a93-a07e-40fd-b04b-114552722a48"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:54:23.160804 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.160782    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a522a93-a07e-40fd-b04b-114552722a48" (UID: "8a522a93-a07e-40fd-b04b-114552722a48"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:54:23.160947 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.160933    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a522a93-a07e-40fd-b04b-114552722a48-kube-api-access-kxjx6" (OuterVolumeSpecName: "kube-api-access-kxjx6") pod "8a522a93-a07e-40fd-b04b-114552722a48" (UID: "8a522a93-a07e-40fd-b04b-114552722a48"). InnerVolumeSpecName "kube-api-access-kxjx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:54:23.259765 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.259725    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxjx6\" (UniqueName: \"kubernetes.io/projected/8a522a93-a07e-40fd-b04b-114552722a48-kube-api-access-kxjx6\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:54:23.259765 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.259758    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a522a93-a07e-40fd-b04b-114552722a48-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:54:23.259765 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.259770    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a522a93-a07e-40fd-b04b-114552722a48-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:54:23.793697 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.793662    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a522a93-a07e-40fd-b04b-114552722a48" containerID="2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c" exitCode=0
Jul 03 15:54:23.793922 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.793703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" event={"ID":"8a522a93-a07e-40fd-b04b-114552722a48","Type":"ContainerDied","Data":"2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c"}
Jul 03 15:54:23.793922 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.793707    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"
Jul 03 15:54:23.793922 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.793749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t" event={"ID":"8a522a93-a07e-40fd-b04b-114552722a48","Type":"ContainerDied","Data":"7535aa101b4646a58c110a9d453447867d9757de15d0c9575c8afec452edf6e6"}
Jul 03 15:54:23.793922 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.793772    2579 scope.go:117] "RemoveContainer" containerID="2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c"
Jul 03 15:54:23.803809 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.803791    2579 scope.go:117] "RemoveContainer" containerID="2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c"
Jul 03 15:54:23.804148 ip-10-0-138-243 kubenswrapper[2579]: E0703 15:54:23.804127    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c\": container with ID starting with 2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c not found: ID does not exist" containerID="2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c"
Jul 03 15:54:23.804207 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.804159    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c"} err="failed to get container status \"2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c\": rpc error: code = NotFound desc = could not find container \"2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c\": container with ID starting with 2493757ee2c2ed9c6efa68b29fc1bcc33f879ae1330d46bd5523c0fb8d31324c not found: ID does not exist"
Jul 03 15:54:23.814650 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.814620    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"]
Jul 03 15:54:23.820903 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:23.820871    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-3703d4-56b9b847b8-pt95t"]
Jul 03 15:54:24.011432 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:54:24.011391    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a522a93-a07e-40fd-b04b-114552722a48" path="/var/lib/kubelet/pods/8a522a93-a07e-40fd-b04b-114552722a48/volumes"
Jul 03 15:55:05.839147 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:05.839104    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"]
Jul 03 15:55:05.839718 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:05.839448    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" podUID="e009d460-8478-4f9d-a087-9dff03f00831" containerName="maas-api" containerID="cri-o://5bb885896a4405503741f54de0d92877deb79d215c1bec177e760ad8a6b7672a" gracePeriod=30
Jul 03 15:55:06.031694 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.031660    2579 generic.go:356] "Generic (PLEG): container finished" podID="e009d460-8478-4f9d-a087-9dff03f00831" containerID="5bb885896a4405503741f54de0d92877deb79d215c1bec177e760ad8a6b7672a" exitCode=0
Jul 03 15:55:06.031881 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.031743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" event={"ID":"e009d460-8478-4f9d-a087-9dff03f00831","Type":"ContainerDied","Data":"5bb885896a4405503741f54de0d92877deb79d215c1bec177e760ad8a6b7672a"}
Jul 03 15:55:06.097787 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.097755    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:55:06.198576 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.198525    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls\") pod \"e009d460-8478-4f9d-a087-9dff03f00831\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") "
Jul 03 15:55:06.198760 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.198669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e009d460-8478-4f9d-a087-9dff03f00831-openshift-service-ca\") pod \"e009d460-8478-4f9d-a087-9dff03f00831\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") "
Jul 03 15:55:06.198760 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.198717    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvtdr\" (UniqueName: \"kubernetes.io/projected/e009d460-8478-4f9d-a087-9dff03f00831-kube-api-access-pvtdr\") pod \"e009d460-8478-4f9d-a087-9dff03f00831\" (UID: \"e009d460-8478-4f9d-a087-9dff03f00831\") "
Jul 03 15:55:06.199042 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.199017    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e009d460-8478-4f9d-a087-9dff03f00831-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e009d460-8478-4f9d-a087-9dff03f00831" (UID: "e009d460-8478-4f9d-a087-9dff03f00831"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 15:55:06.200944 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.200917    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e009d460-8478-4f9d-a087-9dff03f00831-kube-api-access-pvtdr" (OuterVolumeSpecName: "kube-api-access-pvtdr") pod "e009d460-8478-4f9d-a087-9dff03f00831" (UID: "e009d460-8478-4f9d-a087-9dff03f00831"). InnerVolumeSpecName "kube-api-access-pvtdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 15:55:06.201052 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.200925    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e009d460-8478-4f9d-a087-9dff03f00831" (UID: "e009d460-8478-4f9d-a087-9dff03f00831"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 15:55:06.300409 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.300356    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e009d460-8478-4f9d-a087-9dff03f00831-openshift-service-ca\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:55:06.300409 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.300415    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvtdr\" (UniqueName: \"kubernetes.io/projected/e009d460-8478-4f9d-a087-9dff03f00831-kube-api-access-pvtdr\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:55:06.300632 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:06.300429    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e009d460-8478-4f9d-a087-9dff03f00831-maas-api-tls\") on node \"ip-10-0-138-243.ec2.internal\" DevicePath \"\""
Jul 03 15:55:07.038001 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:07.037977    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"
Jul 03 15:55:07.038434 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:07.037969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4" event={"ID":"e009d460-8478-4f9d-a087-9dff03f00831","Type":"ContainerDied","Data":"dab8a8dcf9884cea3af0aff15651214463b34d038d54b6a3e9fcb19075fecc69"}
Jul 03 15:55:07.038434 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:07.038118    2579 scope.go:117] "RemoveContainer" containerID="5bb885896a4405503741f54de0d92877deb79d215c1bec177e760ad8a6b7672a"
Jul 03 15:55:07.065588 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:07.065556    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"]
Jul 03 15:55:07.078288 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:07.078262    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-31658c-5c84d57544-mq9v4"]
Jul 03 15:55:08.010471 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:08.010437    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e009d460-8478-4f9d-a087-9dff03f00831" path="/var/lib/kubelet/pods/e009d460-8478-4f9d-a087-9dff03f00831/volumes"
Jul 03 15:55:17.737828 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:17.737747    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8755677bc-b89qj_f4b38226-3fe3-4508-9ea4-48ffcec006f0/maas-api/0.log"
Jul 03 15:55:17.850514 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:17.850480    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718210-sr6jn_e8433377-ebea-422f-8311-7480d9355777/cleanup/0.log"
Jul 03 15:55:17.969161 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:17.969130    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718225-blfdk_b1ea2a8f-d925-4d32-9a48-8f0a16b8a459/cleanup/0.log"
Jul 03 15:55:18.094926 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:18.094885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7767ddc58d-6fdn2_98328199-8140-4969-98e1-78009c3a4dc0/manager/0.log"
Jul 03 15:55:18.579960 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:18.579877    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-j2ggh_ca559753-2330-4f36-930a-4bd2253712e4/copy-manifests/0.log"
Jul 03 15:55:18.598380 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:18.598333    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-j2ggh_ca559753-2330-4f36-930a-4bd2253712e4/manager/0.log"
Jul 03 15:55:18.824068 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:18.824037    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lc8vr_ee6948ff-5cfc-44f3-87ab-585c41b64509/postgres/0.log"
Jul 03 15:55:21.432570 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:21.432540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qchx6_94102289-8ef7-40d9-b2b3-888f5c33d243/discovery/0.log"
Jul 03 15:55:21.923543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:21.923509    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k7wm5_915f7837-74eb-4459-86a3-30343cce1762/payload-pre-processing/0.log"
Jul 03 15:55:22.047145 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:22.047113    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6vwr7_4cdb1ed8-1236-47ad-a4e2-c35ae395abc0/payload-processing/0.log"
Jul 03 15:55:22.524931 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:22.524903    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-snrt7_5c1d844b-a064-4e01-9f0a-80755b669ab7/main/0.log"
Jul 03 15:55:22.762913 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:22.762881    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-74b2z_b8c6152f-ebb0-47f1-bec9-ad6e1e60f04d/main/0.log"
Jul 03 15:55:23.001432 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:23.001398    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rv5l4_9d08cd56-a25b-4dce-b35d-f6d892b06d7b/main/0.log"
Jul 03 15:55:29.814418 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:29.814386    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kfqtr_9b2cb4f8-3226-40f7-9e55-b4964c8aba30/global-pull-secret-syncer/0.log"
Jul 03 15:55:29.917675 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:29.917638    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swtq4_0261fda3-060d-41e8-8a08-ef2deea6ca5a/konnectivity-agent/0.log"
Jul 03 15:55:29.992877 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:29.992839    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-243.ec2.internal_0e37f959504a10a7ebf5cd6917814e2e/haproxy/0.log"
Jul 03 15:55:37.424334 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.424267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/alertmanager/0.log"
Jul 03 15:55:37.443120 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.443084    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/config-reloader/0.log"
Jul 03 15:55:37.465936 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.465905    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/kube-rbac-proxy-web/0.log"
Jul 03 15:55:37.482753 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.482693    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/kube-rbac-proxy/0.log"
Jul 03 15:55:37.499439 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.499412    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/kube-rbac-proxy-metric/0.log"
Jul 03 15:55:37.514419 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.514388    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/prom-label-proxy/0.log"
Jul 03 15:55:37.532626 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.532588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ff3f28af-241a-43a0-abef-a28c8bd297b9/init-config-reloader/0.log"
Jul 03 15:55:37.595430 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.595398    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-b2hzc_e3fc7c24-2100-43fe-9dd1-858d0947a80a/kube-state-metrics/0.log"
Jul 03 15:55:37.607944 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.607908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-b2hzc_e3fc7c24-2100-43fe-9dd1-858d0947a80a/kube-rbac-proxy-main/0.log"
Jul 03 15:55:37.624519 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.624489    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-b2hzc_e3fc7c24-2100-43fe-9dd1-858d0947a80a/kube-rbac-proxy-self/0.log"
Jul 03 15:55:37.645967 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.645881    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-659c9f7c5-d88rr_d02c3683-aa69-4f58-8ca7-4a0a7f965fac/metrics-server/0.log"
Jul 03 15:55:37.669543 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.669519    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-4tt8z_80735b42-cbc2-48e7-93dc-42a0fc6d005f/monitoring-plugin/0.log"
Jul 03 15:55:37.757811 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.757783    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bn4h5_b96d80b8-a722-41aa-a7fb-2460b7e029df/node-exporter/0.log"
Jul 03 15:55:37.773247 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.773213    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bn4h5_b96d80b8-a722-41aa-a7fb-2460b7e029df/kube-rbac-proxy/0.log"
Jul 03 15:55:37.789912 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.789888    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bn4h5_b96d80b8-a722-41aa-a7fb-2460b7e029df/init-textfile/0.log"
Jul 03 15:55:37.880407 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.880356    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2l9pf_ec5bbd33-21ef-49a8-acd9-c0e1503b19a2/kube-rbac-proxy-main/0.log"
Jul 03 15:55:37.894303 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.894263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2l9pf_ec5bbd33-21ef-49a8-acd9-c0e1503b19a2/kube-rbac-proxy-self/0.log"
Jul 03 15:55:37.910095 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.909981    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-2l9pf_ec5bbd33-21ef-49a8-acd9-c0e1503b19a2/openshift-state-metrics/0.log"
Jul 03 15:55:37.947626 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.947591    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/prometheus/0.log"
Jul 03 15:55:37.973175 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:37.973152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/config-reloader/0.log"
Jul 03 15:55:38.001568 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.001533    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/thanos-sidecar/0.log"
Jul 03 15:55:38.016898 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.016865    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/kube-rbac-proxy-web/0.log"
Jul 03 15:55:38.033552 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.033531    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/kube-rbac-proxy/0.log"
Jul 03 15:55:38.049105 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.049081    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/kube-rbac-proxy-thanos/0.log"
Jul 03 15:55:38.067005 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.066980    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_719e2246-8eaf-4316-9639-45780f12d93b/init-config-reloader/0.log"
Jul 03 15:55:38.092879 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.092848    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4fmdz_99128881-126a-46d6-ac9e-8a681300e818/prometheus-operator/0.log"
Jul 03 15:55:38.108919 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.108888    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4fmdz_99128881-126a-46d6-ac9e-8a681300e818/kube-rbac-proxy/0.log"
Jul 03 15:55:38.129434 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.129392    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-xmk8x_10c73981-e171-4596-b432-0c5f0c4cd8e1/prometheus-operator-admission-webhook/0.log"
Jul 03 15:55:38.169683 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.169553    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86664cf6b9-9sbgq_be9c90bd-cb03-45d5-b202-d90e2fd80d89/telemeter-client/0.log"
Jul 03 15:55:38.185593 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.185558    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86664cf6b9-9sbgq_be9c90bd-cb03-45d5-b202-d90e2fd80d89/reload/0.log"
Jul 03 15:55:38.205469 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.205442    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86664cf6b9-9sbgq_be9c90bd-cb03-45d5-b202-d90e2fd80d89/kube-rbac-proxy/0.log"
Jul 03 15:55:38.234848 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.234815    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fd87bb5f8-t2dzg_adcc94ff-126d-49d7-83d0-0c0d8e147b70/thanos-query/0.log"
Jul 03 15:55:38.257097 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.257067    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fd87bb5f8-t2dzg_adcc94ff-126d-49d7-83d0-0c0d8e147b70/kube-rbac-proxy-web/0.log"
Jul 03 15:55:38.282153 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.282120    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fd87bb5f8-t2dzg_adcc94ff-126d-49d7-83d0-0c0d8e147b70/kube-rbac-proxy/0.log"
Jul 03 15:55:38.296944 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.296918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fd87bb5f8-t2dzg_adcc94ff-126d-49d7-83d0-0c0d8e147b70/prom-label-proxy/0.log"
Jul 03 15:55:38.313601 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.313571    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fd87bb5f8-t2dzg_adcc94ff-126d-49d7-83d0-0c0d8e147b70/kube-rbac-proxy-rules/0.log"
Jul 03 15:55:38.332828 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:38.332801    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5fd87bb5f8-t2dzg_adcc94ff-126d-49d7-83d0-0c0d8e147b70/kube-rbac-proxy-metrics/0.log"
Jul 03 15:55:40.164786 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.164751    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"]
Jul 03 15:55:40.165198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.165184    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a522a93-a07e-40fd-b04b-114552722a48" containerName="maas-api"
Jul 03 15:55:40.165198 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.165199    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a522a93-a07e-40fd-b04b-114552722a48" containerName="maas-api"
Jul 03 15:55:40.165276 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.165208    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e009d460-8478-4f9d-a087-9dff03f00831" containerName="maas-api"
Jul 03 15:55:40.165276 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.165215    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e009d460-8478-4f9d-a087-9dff03f00831" containerName="maas-api"
Jul 03 15:55:40.165338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.165279    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a522a93-a07e-40fd-b04b-114552722a48" containerName="maas-api"
Jul 03 15:55:40.165338 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.165288    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e009d460-8478-4f9d-a087-9dff03f00831" containerName="maas-api"
Jul 03 15:55:40.168703 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.168681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.171557 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.171537    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2795n\"/\"kube-root-ca.crt\""
Jul 03 15:55:40.172879 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.172860    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2795n\"/\"default-dockercfg-t2c96\""
Jul 03 15:55:40.172938 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.172898    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2795n\"/\"openshift-service-ca.crt\""
Jul 03 15:55:40.177663 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.177633    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"]
Jul 03 15:55:40.244083 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.244046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlvpz\" (UniqueName: \"kubernetes.io/projected/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-kube-api-access-mlvpz\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.244083 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.244090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-lib-modules\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.244322 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.244118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-podres\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.244322 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.244230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-sys\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.244322 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.244275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-proc\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.345733 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlvpz\" (UniqueName: \"kubernetes.io/projected/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-kube-api-access-mlvpz\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.345733 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-lib-modules\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-podres\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-sys\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-proc\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345952    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-proc\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345954    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-podres\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345972    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-sys\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.346003 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.345956    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-lib-modules\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.354353 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.354325    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlvpz\" (UniqueName: \"kubernetes.io/projected/d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5-kube-api-access-mlvpz\") pod \"perf-node-gather-daemonset-b2dwd\" (UID: \"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5\") " pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.480590 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.480492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:40.628865 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.628834    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"]
Jul 03 15:55:40.632020 ip-10-0-138-243 kubenswrapper[2579]: W0703 15:55:40.631983    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd3cdf8c6_d47c_4600_9b90_3c57a7bd35e5.slice/crio-aa1a31bd140ee920ff18dfcb1eafe6ce54291f2a109fa8145142dcafab093b84 WatchSource:0}: Error finding container aa1a31bd140ee920ff18dfcb1eafe6ce54291f2a109fa8145142dcafab093b84: Status 404 returned error can't find the container with id aa1a31bd140ee920ff18dfcb1eafe6ce54291f2a109fa8145142dcafab093b84
Jul 03 15:55:40.741635 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:40.741543    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-49wb5_f900f538-ee9c-40b9-b807-6e4211a788d5/download-server/0.log"
Jul 03 15:55:41.220234 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:41.220192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd" event={"ID":"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5","Type":"ContainerStarted","Data":"5679f2f6895a5b8c96ff8da9cca04510d90bfbb14d21caef2ffa5756465ae8c7"}
Jul 03 15:55:41.220664 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:41.220243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd" event={"ID":"d3cdf8c6-d47c-4600-9b90-3c57a7bd35e5","Type":"ContainerStarted","Data":"aa1a31bd140ee920ff18dfcb1eafe6ce54291f2a109fa8145142dcafab093b84"}
Jul 03 15:55:41.220664 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:41.220277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:41.237601 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:41.237554    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd" podStartSLOduration=1.237537177 podStartE2EDuration="1.237537177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 15:55:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 15:55:41.237233717 +0000 UTC m=+2541.711415322" watchObservedRunningTime="2026-07-03 15:55:41.237537177 +0000 UTC m=+2541.711718781"
Jul 03 15:55:42.431045 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:42.431015    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qnc5c_fa622d7d-633d-4ca8-8e08-caa95cf3511f/dns/0.log"
Jul 03 15:55:42.449110 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:42.449085    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qnc5c_fa622d7d-633d-4ca8-8e08-caa95cf3511f/kube-rbac-proxy/0.log"
Jul 03 15:55:42.489500 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:42.489461    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nm97r_a31732f9-d018-4dcb-9801-f08e5a7a0d7b/dns-node-resolver/0.log"
Jul 03 15:55:43.055675 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:43.055645    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bz4g4_022d0d05-74fc-49bc-8687-223939b898d1/node-ca/0.log"
Jul 03 15:55:44.154056 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:44.153999    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qchx6_94102289-8ef7-40d9-b2b3-888f5c33d243/discovery/0.log"
Jul 03 15:55:44.289032 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:44.288988    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k7wm5_915f7837-74eb-4459-86a3-30343cce1762/payload-pre-processing/0.log"
Jul 03 15:55:44.365506 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:44.365473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6vwr7_4cdb1ed8-1236-47ad-a4e2-c35ae395abc0/payload-processing/0.log"
Jul 03 15:55:45.060447 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:45.060414    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rfl28_ac626881-f507-4b2c-8c89-578f06e48c78/serve-healthcheck-canary/0.log"
Jul 03 15:55:45.625173 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:45.625144    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcdr2_e6500bce-2605-41e2-a674-17a776e1b65c/kube-rbac-proxy/0.log"
Jul 03 15:55:45.642278 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:45.642252    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcdr2_e6500bce-2605-41e2-a674-17a776e1b65c/exporter/0.log"
Jul 03 15:55:45.659278 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:45.659249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcdr2_e6500bce-2605-41e2-a674-17a776e1b65c/extractor/0.log"
Jul 03 15:55:47.236607 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:47.236576    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2795n/perf-node-gather-daemonset-b2dwd"
Jul 03 15:55:47.930453 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:47.930414    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8755677bc-b89qj_f4b38226-3fe3-4508-9ea4-48ffcec006f0/maas-api/0.log"
Jul 03 15:55:47.946005 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:47.945971    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718210-sr6jn_e8433377-ebea-422f-8311-7480d9355777/cleanup/0.log"
Jul 03 15:55:47.968224 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:47.968184    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718225-blfdk_b1ea2a8f-d925-4d32-9a48-8f0a16b8a459/cleanup/0.log"
Jul 03 15:55:48.127775 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:48.127735    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7767ddc58d-6fdn2_98328199-8140-4969-98e1-78009c3a4dc0/manager/0.log"
Jul 03 15:55:48.397961 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:48.397928    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-j2ggh_ca559753-2330-4f36-930a-4bd2253712e4/manager/0.log"
Jul 03 15:55:48.412686 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:48.412661    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86b59fc499-j2ggh_ca559753-2330-4f36-930a-4bd2253712e4/copy-manifests/0.log"
Jul 03 15:55:48.473764 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:48.473728    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lc8vr_ee6948ff-5cfc-44f3-87ab-585c41b64509/postgres/0.log"
Jul 03 15:55:49.998847 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:49.998813    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c796b4fcc-6v5vq_f96150c6-9c08-4acf-bf3d-242c20c86514/manager/0.log"
Jul 03 15:55:50.683921 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:50.683884    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qchx6_94102289-8ef7-40d9-b2b3-888f5c33d243/discovery/0.log"
Jul 03 15:55:50.792614 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:50.792575    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k7wm5_915f7837-74eb-4459-86a3-30343cce1762/payload-pre-processing/0.log"
Jul 03 15:55:50.856684 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:50.856636    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6vwr7_4cdb1ed8-1236-47ad-a4e2-c35ae395abc0/payload-processing/0.log"
Jul 03 15:55:52.312305 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:52.312210    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qchx6_94102289-8ef7-40d9-b2b3-888f5c33d243/discovery/0.log"
Jul 03 15:55:52.418691 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:52.418654    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-k7wm5_915f7837-74eb-4459-86a3-30343cce1762/payload-pre-processing/0.log"
Jul 03 15:55:52.486351 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:52.486314    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6vwr7_4cdb1ed8-1236-47ad-a4e2-c35ae395abc0/payload-processing/0.log"
Jul 03 15:55:56.452403 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.452376    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/kube-multus-additional-cni-plugins/0.log"
Jul 03 15:55:56.470299 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.470267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/egress-router-binary-copy/0.log"
Jul 03 15:55:56.488046 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.488017    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/cni-plugins/0.log"
Jul 03 15:55:56.504401 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.504347    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/bond-cni-plugin/0.log"
Jul 03 15:55:56.520381 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.520328    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/routeoverride-cni/0.log"
Jul 03 15:55:56.536581 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.536552    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/whereabouts-cni-bincopy/0.log"
Jul 03 15:55:56.552824 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.552792    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wpmcz_a6c97aa9-ad65-41f0-9ddc-d2287826fabd/whereabouts-cni/0.log"
Jul 03 15:55:56.645717 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.645681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xllhm_1c2f861c-a8a3-4fbe-82db-a799615d3f9c/kube-multus/0.log"
Jul 03 15:55:56.702565 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.702535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rf68h_d1ce76a1-680f-4770-8e68-5b152eda3ccb/network-metrics-daemon/0.log"
Jul 03 15:55:56.714616 ip-10-0-138-243 kubenswrapper[2579]: I0703 15:55:56.714591    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rf68h_d1ce76a1-680f-4770-8e68-5b152eda3ccb/kube-rbac-proxy/0.log"