Jul 10 13:48:35.066173 ip-10-0-129-218 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 13:48:35.066184 ip-10-0-129-218 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 13:48:35.066192 ip-10-0-129-218 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 13:48:35.066468 ip-10-0-129-218 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 13:48:45.208808 ip-10-0-129-218 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 13:48:45.208825 ip-10-0-129-218 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3fb149cd732b4c50ade5fcb81a679548 --
Jul 10 13:50:24.500396 ip-10-0-129-218 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.900021    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906414    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906426    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906430    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906434    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906437    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906440    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906443    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:50:25.016034 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906446    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:50:24.971027 ip-10-0-129-218 systemd[1]: Started Kubernetes Kubelet.
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906449    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906452    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906455    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906459    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906462    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906465    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906467    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906470    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906473    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906476    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906478    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906481    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906483    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906488    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906490    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906493    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906496    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906499    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:50:25.031462 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906501    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906504    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906507    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906510    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906512    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906515    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906518    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906520    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906522    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906525    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906527    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906530    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906532    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906535    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906537    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906540    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906542    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906545    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906548    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906550    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:50:25.056795 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906553    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906556    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906558    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906561    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906564    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906566    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906569    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906572    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906574    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906577    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906580    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906583    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906585    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906590    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906593    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906595    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906598    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906601    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906603    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906606    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:50:25.203582 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906609    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906613    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906615    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906618    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906621    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906624    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906627    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906629    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906632    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906636    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906640    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906643    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906646    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906649    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906652    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906654    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906657    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906660    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906663    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906666    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:50:25.204839 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906668    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906671    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906673    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906676    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906679    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906683    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906687    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906689    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906692    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906695    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906698    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906702    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.906706    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907430    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907437    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907441    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907444    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907446    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907450    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:50:25.205821 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907453    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907456    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907458    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907461    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907464    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907466    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907469    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907472    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907474    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907477    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907480    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907482    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907485    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907488    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907490    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907493    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907495    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907498    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907501    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907503    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:50:25.206405 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907506    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907508    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907511    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907514    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907519    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907522    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907525    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907527    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907530    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907533    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907536    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907539    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907542    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907544    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907547    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907549    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907552    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907554    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907556    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907559    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:50:25.207035 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907561    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907564    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907567    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907569    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907572    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907575    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907580    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907583    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907585    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907588    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907590    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907593    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907598    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907600    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907603    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907605    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907609    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907612    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907614    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907617    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:50:25.207645 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907619    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907622    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907624    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907627    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907630    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907633    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907636    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907639    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907642    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907644    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907647    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907650    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907653    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907655    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907658    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907660    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907662    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907666    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907672    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907675    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:50:25.208278 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907678    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907681    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907683    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907686    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907688    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907691    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907693    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907696    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907700    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907703    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907706    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907709    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.907713    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908096    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908101    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908104    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908107    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908110    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908113    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:50:25.208909 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908116    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908118    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908121    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908124    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908126    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908129    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908131    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908134    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908136    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908139    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908141    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908145    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908148    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908151    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908153    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908156    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908158    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908161    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908163    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908166    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:50:25.209562 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908168    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908172    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908175    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908178    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908180    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908183    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908185    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908188    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908191    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908193    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908196    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908199    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908202    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908204    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908207    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908210    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908212    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908215    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908217    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908220    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:50:25.210178 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908222    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908224    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908227    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908231    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908233    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908236    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908240    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908244    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908246    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908249    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908251    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908254    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908257    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908261    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908263    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908265    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908269    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908273    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908276    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:50:25.210796 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908278    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908281    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908283    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908286    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908289    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908293    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908296    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908299    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908302    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908304    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908307    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908309    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908312    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908314    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908317    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908319    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908324    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908327    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908330    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:50:25.211317 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908332    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908335    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908337    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908340    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908342    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908345    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908347    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908351    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908354    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908357    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908359    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908362    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908364    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908367    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.908369    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908451    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908461    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908483    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908489    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908494    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908497    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 13:50:25.211855 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908501    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908505    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908509    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908512    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908515    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908518    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908521    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908524    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908530    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908533    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908536    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908539    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908543    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908546    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908549    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908552    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908555    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908559    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908564    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908568    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908571    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908574    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908577    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908580    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 13:50:25.212449 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908584    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908587    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908590    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908594    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908596    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908599    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908602    2561 flags.go:64] FLAG: --enable-server="true"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908605    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908610    2561 flags.go:64] FLAG: --event-burst="100"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908614    2561 flags.go:64] FLAG: --event-qps="50"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908617    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908633    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908637    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908641    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908644    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908647    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908652    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908655    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908658    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908660    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908663    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908666    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908669    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908672    2561 flags.go:64] FLAG: --feature-gates=""
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908675    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 13:50:25.213137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908678    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908682    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908685    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908688    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908692    2561 flags.go:64] FLAG: --help="false"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908694    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908697    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908700    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908703    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908706    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908710    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908712    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908715    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908718    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908721    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908724    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908727    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908730    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908733    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908735    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908746    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908749    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908752    2561 flags.go:64] FLAG: --lock-file=""
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908756    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 13:50:25.213863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908759    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908762    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908768    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908770    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908773    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908776    2561 flags.go:64] FLAG: --logging-format="text"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908779    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908782    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908785    2561 flags.go:64] FLAG: --manifest-url=""
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908790    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908795    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908798    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908803    2561 flags.go:64] FLAG: --max-pods="110"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908806    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908808    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908811    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908814    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908817    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908820    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908823    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908831    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908834    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908837    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 13:50:25.214551 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908839    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908843    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908849    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908852    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908855    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908858    2561 flags.go:64] FLAG: --port="10250"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908861    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908863    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05de149bc79b1e2f6"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908867    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908871    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908874    2561 flags.go:64] FLAG: --register-node="true"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908877    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908881    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908883    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908886    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908889    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908893    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908896    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908901    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908904    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908907    2561 flags.go:64] FLAG: --runonce="false"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908910    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908913    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908916    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908919    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 13:50:25.221279 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908921    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908924    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908928    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908931    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908934    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908937    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908940    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908942    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908945    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908949    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908952    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908957    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908960    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908963    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908966    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908969    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908973    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908976    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908979    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908982    2561 flags.go:64] FLAG: --v="2"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908986    2561 flags.go:64] FLAG: --version="false"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908990    2561 flags.go:64] FLAG: --vmodule=""
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908993    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.908997    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909131    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:50:25.223605 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909138    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909158    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909171    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909175    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909180    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909184    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909187    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909190    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909193    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909196    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909199    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909201    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909204    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909207    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909211    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909215    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909218    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909221    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909224    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:50:25.349846 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909227    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909229    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909232    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909234    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909237    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909239    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909242    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909245    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909247    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909250    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909253    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909256    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909258    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909261    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909263    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909266    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909269    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909272    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909274    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909277    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:50:25.350534 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909279    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909282    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909284    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909287    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909289    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909292    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909294    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909297    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909299    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909302    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909304    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909307    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909310    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909312    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909315    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909318    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909321    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909323    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909326    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:50:25.351151 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909330    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909333    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909336    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909341    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909344    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909347    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909350    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909352    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909355    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909358    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909361    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909364    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909366    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909369    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909371    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909374    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909376    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909379    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909382    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909384    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:50:25.351777 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909387    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909389    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909392    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909394    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909397    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909400    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909404    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909407    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909409    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909412    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909414    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909417    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909419    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909422    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909425    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909430    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909433    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909436    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909438    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:50:25.352359 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.909441    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.909451    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.916182    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.916196    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.916215    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.916220    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916274    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916280    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916283    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916286    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916289    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916292    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916294    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916297    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:50:25.352905 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916300    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916302    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916305    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916308    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916311    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916314    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916317    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916319    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916323    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916328    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916331    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916334    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916337    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916340    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916343    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916346    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916348    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916351    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916354    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:50:25.353312 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916358    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916361    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916364    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916367    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916369    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916372    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916375    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916377    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916380    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916384    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916388    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916391    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916397    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916400    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916402    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916405    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916409    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916412    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916414    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:50:25.353855 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916417    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916420    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916422    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916425    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916427    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916430    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916433    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916435    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916438    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916442    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916445    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916448    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916451    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916454    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916457    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916460    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916463    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916466    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916469    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916471    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:50:25.354377 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916474    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916477    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916479    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916482    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916484    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916488    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916491    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916493    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916496    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916499    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916501    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916504    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916507    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916509    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916512    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916514    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916517    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916519    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916522    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916524    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:50:25.354942 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916527    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916529    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916532    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916534    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916537    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916539    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916541    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916544    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916546    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916549    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916551    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916554    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916556    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.916561    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916675    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 13:50:25.355484 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916679    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916682    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916686    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916689    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916692    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916695    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916697    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916701    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916704    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916708    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916710    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916713    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916715    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916718    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916720    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916723    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916726    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916728    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916731    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 13:50:25.355936 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916733    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916736    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916786    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916789    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916792    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916794    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916814    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916819    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.916822    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917036    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917040    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917042    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917467    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917470    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917473    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917689    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917692    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917695    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917697    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917700    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 13:50:25.356450 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917914    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917917    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917921    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917924    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.917927    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918078    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918082    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918086    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918090    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918095    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918098    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918102    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918105    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918108    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918110    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918113    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918115    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918118    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918120    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 13:50:25.357031 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918123    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918125    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918128    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918131    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918133    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918136    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918139    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918142    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918146    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918148    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918151    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918153    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918156    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918161    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918163    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918166    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918169    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918172    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918175    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918178    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 13:50:25.357545 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918180    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918183    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918185    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918188    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918190    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918193    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918195    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918198    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918201    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918204    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918206    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918418    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918421    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918424    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918427    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918429    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918636    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918639    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918642    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 13:50:25.358199 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:24.918644    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.918852    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.919180    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.922113    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.923432    2561 server.go:1019] "Starting client certificate rotation"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.923533    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.924358    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.925795    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.928761    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.941373    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.943343    2561 log.go:25] "Validated CRI v1 image API"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.944148    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 13:50:25.358691 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.946372    2561 fs.go:135] Filesystem UUIDs: map[0880efee-fccd-4ea0-a41a-c768b2d6cd0b:/dev/nvme0n1p4 16cdc975-fa08-4d57-9aeb-30df013189a6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 10 13:50:25.359073 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.946397    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.951425    2561 manager.go:216] Machine: {Timestamp:2026-07-10 13:50:24.950799829 +0000 UTC m=+0.334998740 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100352 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3fe4063996a8f4ab3b78cc43b557 SystemUUID:ec2d3fe4-0639-96a8-f4ab-3b78cc43b557 BootID:3fb149cd-732b-4c50-ade5-fcb81a679548 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:8f:ca:f6:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:8f:ca:f6:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:b1:d0:ab:cc:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.951519    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.951597    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.953676    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.954554    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.954584    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 13:50:25.359141 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.955358    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.955369    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.955376    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.955387    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.956200    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959007    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959132    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959166    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959180    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959192    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959201    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959209    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959514    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.959527    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.961650    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.963560    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.963587    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964141    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964155    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964161    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964167    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964176    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964181    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964289    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964295    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964303    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964309    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964318    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.964326    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.966282    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.966291    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.970217    2561 server.go:1268] "Started kubelet"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.970279    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.970348    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.970412    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.972948    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.973594    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.973632    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.973887    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 13:50:25.359425 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.975095    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.977178    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.976851    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-218.ec2.internal.18c0f1e68e3e37a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-218.ec2.internal,UID:ip-10-0-129-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-218.ec2.internal,},FirstTimestamp:2026-07-10 13:50:24.969930659 +0000 UTC m=+0.354129569,LastTimestamp:2026-07-10 13:50:24.969930659 +0000 UTC m=+0.354129569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-218.ec2.internal,}"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.980656    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.980672    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.980718    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.981168    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.981241    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.981257    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.981387    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.981394    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.982907    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.982921    2561 factory.go:55] Registering systemd factory
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.982928    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.983204    2561 factory.go:153] Registering CRI-O factory
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.983216    2561 factory.go:223] Registration of the crio container factory successfully
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.983237    2561 factory.go:103] Registering Raw factory
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.983249    2561 manager.go:1196] Started watching for new ooms in manager
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.983687    2561 manager.go:349] Starting recovery of all containers
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.984721    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:24.984781    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.993343    2561 manager.go:354] Recovery completed
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.997533    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.999880    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.999912    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:24.999923    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.000542    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.000553    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.000569    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.001087    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.001423    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7xf8x"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.001941    2561 policy_none.go:49] "None policy: Start"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.001954    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 13:50:25.360716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.001964    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.002367    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.002392    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.002405    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.003109    2561 policy_none.go:47] "Start"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.012702    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-218.ec2.internal.18c0f1e6900780c3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-218.ec2.internal,UID:ip-10-0-129-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-218.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-218.ec2.internal,},FirstTimestamp:2026-07-10 13:50:24.999899331 +0000 UTC m=+0.384098241,LastTimestamp:2026-07-10 13:50:24.999899331 +0000 UTC m=+0.384098241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-218.ec2.internal,}"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.013854    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7xf8x"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.080769    2561 manager.go:337] "Starting Device Plugin manager"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.080769    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.080903    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.080917    2561 server.go:87] "Starting device plugin registration server"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.081233    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.081246    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.081334    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.081423    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.081430    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.081984    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.082029    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.134217    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.135534    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.135576    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.135603    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.135651    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.138080    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.182345    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.183909    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.183942    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.183956    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.183984    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.194262    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.194287    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-218.ec2.internal\": node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.361857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.218715    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.235918    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"]
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.235985    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.236901    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.236922    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.236931    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.238293    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.238632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.238654    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.239358    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.239376    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.239386    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.240292    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.240315    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.240329    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.241534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.241554    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.242249    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.242268    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.242278    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.265673    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-218.ec2.internal\" not found" node="ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.269929    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-218.ec2.internal\" not found" node="ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.282575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17c2bdf5eafc896f76b1a9769b40bfcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal\" (UID: \"17c2bdf5eafc896f76b1a9769b40bfcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.282598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c2bdf5eafc896f76b1a9769b40bfcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal\" (UID: \"17c2bdf5eafc896f76b1a9769b40bfcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.282615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1452b6b6e59b37d37fbed58ab4b2c18d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-218.ec2.internal\" (UID: \"1452b6b6e59b37d37fbed58ab4b2c18d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518086 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.319368    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.384451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17c2bdf5eafc896f76b1a9769b40bfcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal\" (UID: \"17c2bdf5eafc896f76b1a9769b40bfcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.384502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c2bdf5eafc896f76b1a9769b40bfcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal\" (UID: \"17c2bdf5eafc896f76b1a9769b40bfcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.384455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17c2bdf5eafc896f76b1a9769b40bfcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal\" (UID: \"17c2bdf5eafc896f76b1a9769b40bfcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.384558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1452b6b6e59b37d37fbed58ab4b2c18d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-218.ec2.internal\" (UID: \"1452b6b6e59b37d37fbed58ab4b2c18d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.384577    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c2bdf5eafc896f76b1a9769b40bfcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal\" (UID: \"17c2bdf5eafc896f76b1a9769b40bfcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.384627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1452b6b6e59b37d37fbed58ab4b2c18d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-218.ec2.internal\" (UID: \"1452b6b6e59b37d37fbed58ab4b2c18d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.518842 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.420246    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.663866 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.520477    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.663866 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.567673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.663866 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.572567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:25.663866 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.620731    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.819819 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.721201    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.822605 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.822199    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.977800 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.907870    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:50:25.977800 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:25.922351    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:25.977800 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.925478    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 13:50:25.977800 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.925637    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 13:50:25.977800 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:25.925663    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 13:50:26.131533 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.017928    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 13:45:25 +0000 UTC" deadline="2028-01-28 13:56:41.633140715 +0000 UTC"
Jul 10 13:50:26.131533 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.017966    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13608h6m15.61518289s"
Jul 10 13:50:26.131533 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:26.031769    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:26.137282 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:26.136532    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-218.ec2.internal\" not found"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.141510    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.142696    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.142725    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.142735    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeHasSufficientPID"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.180292    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.181252    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.193137    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.195553    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal"
Jul 10 13:50:26.246513 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.209328    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 13:50:26.360515 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:26.331749    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1452b6b6e59b37d37fbed58ab4b2c18d.slice/crio-e9ebba34469d3a12d68aeedaea027ccaafa7fa64320b3dede7e0b21713b1c877 WatchSource:0}: Error finding container e9ebba34469d3a12d68aeedaea027ccaafa7fa64320b3dede7e0b21713b1c877: Status 404 returned error can't find the container with id e9ebba34469d3a12d68aeedaea027ccaafa7fa64320b3dede7e0b21713b1c877
Jul 10 13:50:26.360515 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:26.332243    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c2bdf5eafc896f76b1a9769b40bfcb.slice/crio-81239221b47bb4cff8b8080d420c6508ef681e0a44dd21c95beb0272349df0c1 WatchSource:0}: Error finding container 81239221b47bb4cff8b8080d420c6508ef681e0a44dd21c95beb0272349df0c1: Status 404 returned error can't find the container with id 81239221b47bb4cff8b8080d420c6508ef681e0a44dd21c95beb0272349df0c1
Jul 10 13:50:26.360515 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.346112    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 13:50:26.504021 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.431284    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.960860    2561 apiserver.go:52] "Watching apiserver"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.969722    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.970130    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dgxkz","kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal","openshift-multus/multus-79r87","openshift-multus/network-metrics-daemon-297nd","openshift-network-diagnostics/network-check-target-pjvbd","openshift-network-operator/iptables-alerter-jdcsc","kube-system/global-pull-secret-syncer-qkdpl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk","openshift-cluster-node-tuning-operator/tuned-fz8k4","openshift-dns/node-resolver-ms2rz","openshift-image-registry/node-ca-gtnzm","openshift-multus/multus-additional-cni-plugins-9hzt2","openshift-ovn-kubernetes/ovnkube-node-r9lrl"]
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.971800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.973247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.974413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.974710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.974827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5h7t4\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.975783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.977347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:26.977420    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.989641    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.989641    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.989726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990279    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990320    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990355    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990434    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990498    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990559    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990573    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990866    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990874    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.990790    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.991245    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bw95n\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.991338    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h6w6s\""
Jul 10 13:50:27.008196 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.991482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.991578    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9q5wf\""
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.991600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.993014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:26.993136    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.994902    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:26.994958    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:27.011540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:26.996825    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.043403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.043840    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.043929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjsc\" (UniqueName: \"kubernetes.io/projected/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-kube-api-access-jdjsc\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-host\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-system-cni-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044272    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rhrct\""
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-iptables-alerter-script\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-serviceca\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpklz\" (UniqueName: \"kubernetes.io/projected/98dee2b9-71ba-4c44-b542-62d10e211869-kube-api-access-kpklz\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvs94\" (UniqueName: \"kubernetes.io/projected/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-kube-api-access-vvs94\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvrrs\" (UniqueName: \"kubernetes.io/projected/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-kube-api-access-jvrrs\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-system-cni-dir\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cni-binary-copy\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.097478 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-cnibin\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-os-release\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98dee2b9-71ba-4c44-b542-62d10e211869-cni-binary-copy\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044748    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-hostroot\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-etc-kubernetes\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysconfig\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.044907    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-host\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-host-slash\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-socket-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045368    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-sys-fs\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-cni-multus\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-kubernetes\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045390    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.099694 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-sys\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-device-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045750    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-socket-dir-parent\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-k8s-cni-cncf-io\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.045976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f2587ff-aeec-4506-8144-77bc9d01c0a8-hosts-file\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.046020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-os-release\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.047022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-run\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-cni-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-netns\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-conf-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058551    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-multus-certs\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.100396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7jt\" (UniqueName: \"kubernetes.io/projected/7f2587ff-aeec-4506-8144-77bc9d01c0a8-kube-api-access-2z7jt\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m4j4j\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059239    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2qjlb\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059356    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059505    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gdkzq\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059540    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059671    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059798    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.059867    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058810    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.058537    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2wkd\""
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cnibin\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-kubelet\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcs7\" (UniqueName: \"kubernetes.io/projected/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-kube-api-access-jjcs7\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-systemd\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-var-lib-kubelet\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvchx\" (UniqueName: \"kubernetes.io/projected/751718d9-c6df-4efb-b106-7f76115ae0cc-kube-api-access-qvchx\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.060975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-lib-modules\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.102805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0070a-1d3a-4825-a0c3-96e51fa60e1b-konnectivity-ca\") pod \"konnectivity-agent-dgxkz\" (UID: \"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b\") " pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98dee2b9-71ba-4c44-b542-62d10e211869-multus-daemon-config\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb7ceb8-d2df-49b4-9365-0b56346f3076-tmp\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-cni-bin\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2587ff-aeec-4506-8144-77bc9d01c0a8-tmp-dir\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysctl-d\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-tuned\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jx4n\" (UniqueName: \"kubernetes.io/projected/0eb7ceb8-d2df-49b4-9365-0b56346f3076-kube-api-access-5jx4n\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cf0070a-1d3a-4825-a0c3-96e51fa60e1b-agent-certs\") pod \"konnectivity-agent-dgxkz\" (UID: \"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b\") " pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-modprobe-d\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysctl-conf\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.061340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-registration-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.067853    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 13:50:27.103805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.067943    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wznhd"
Jul 10 13:50:27.106633 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.082658    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.139976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal" event={"ID":"1452b6b6e59b37d37fbed58ab4b2c18d","Type":"ContainerStarted","Data":"e9ebba34469d3a12d68aeedaea027ccaafa7fa64320b3dede7e0b21713b1c877"}
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.141085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal" event={"ID":"17c2bdf5eafc896f76b1a9769b40bfcb","Type":"ContainerStarted","Data":"81239221b47bb4cff8b8080d420c6508ef681e0a44dd21c95beb0272349df0c1"}
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.143505    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-node-log\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-env-overrides\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-cni-bin\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162577    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2587ff-aeec-4506-8144-77bc9d01c0a8-tmp-dir\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysctl-d\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-cni-bin\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-tuned\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jx4n\" (UniqueName: \"kubernetes.io/projected/0eb7ceb8-d2df-49b4-9365-0b56346f3076-kube-api-access-5jx4n\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162826    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysctl-d\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-systemd-units\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cf0070a-1d3a-4825-a0c3-96e51fa60e1b-agent-certs\") pod \"konnectivity-agent-dgxkz\" (UID: \"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b\") " pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.198834 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-modprobe-d\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.162996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysctl-conf\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2587ff-aeec-4506-8144-77bc9d01c0a8-tmp-dir\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163089    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysctl-conf\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-modprobe-d\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-registration-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjsc\" (UniqueName: \"kubernetes.io/projected/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-kube-api-access-jdjsc\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.201609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-host\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-registration-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-system-cni-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163399    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-iptables-alerter-script\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-host\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-cni-bin\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-system-cni-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163557    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-serviceca\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpklz\" (UniqueName: \"kubernetes.io/projected/98dee2b9-71ba-4c44-b542-62d10e211869-kube-api-access-kpklz\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163618    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvs94\" (UniqueName: \"kubernetes.io/projected/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-kube-api-access-vvs94\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-systemd\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-log-socket\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvrrs\" (UniqueName: \"kubernetes.io/projected/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-kube-api-access-jvrrs\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.202561 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-system-cni-dir\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cni-binary-copy\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-ovn\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6672fb14-fb97-4899-b368-e55e1a7b6c20-dbus\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-cnibin\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-os-release\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98dee2b9-71ba-4c44-b542-62d10e211869-cni-binary-copy\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-hostroot\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-etc-kubernetes\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.163985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysconfig\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-host\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-kubelet\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-run-netns\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.270422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-host-slash\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovn-node-metrics-cert\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-socket-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-sys-fs\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-cni-multus\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-serviceca\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164506    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-cni-multus\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-hostroot\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-etc-kubernetes\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-kubernetes\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-cnibin\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.271560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-cni-netd\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glj7l\" (UniqueName: \"kubernetes.io/projected/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-kube-api-access-glj7l\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164683    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-sysconfig\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-sys\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-host\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-device-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-socket-dir-parent\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-k8s-cni-cncf-io\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f2587ff-aeec-4506-8144-77bc9d01c0a8-hosts-file\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-iptables-alerter-script\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-os-release\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f2587ff-aeec-4506-8144-77bc9d01c0a8-hosts-file\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.164988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.272480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-device-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-socket-dir\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-run\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-cni-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-slash\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165091    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cni-binary-copy\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-os-release\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovnkube-script-lib\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-netns\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-os-release\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-sys\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-conf-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165298    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98dee2b9-71ba-4c44-b542-62d10e211869-cni-binary-copy\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165311    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-multus-certs\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-run\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.273626 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7jt\" (UniqueName: \"kubernetes.io/projected/7f2587ff-aeec-4506-8144-77bc9d01c0a8-kube-api-access-2z7jt\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cnibin\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-cni-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-socket-dir-parent\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-etc-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovnkube-config\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-kubelet\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcs7\" (UniqueName: \"kubernetes.io/projected/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-kube-api-access-jjcs7\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-systemd\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-system-cni-dir\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-var-lib-kubelet\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.165749    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-var-lib-kubelet\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.274540 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-netns\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6672fb14-fb97-4899-b368-e55e1a7b6c20-kubelet-config\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.165821    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:50:27.66579842 +0000 UTC m=+3.049997345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvchx\" (UniqueName: \"kubernetes.io/projected/751718d9-c6df-4efb-b106-7f76115ae0cc-kube-api-access-qvchx\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cnibin\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-k8s-cni-cncf-io\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-host-run-multus-certs\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-lib-modules\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.165972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-systemd\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0070a-1d3a-4825-a0c3-96e51fa60e1b-konnectivity-ca\") pod \"konnectivity-agent-dgxkz\" (UID: \"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b\") " pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166053    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-var-lib-kubelet\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98dee2b9-71ba-4c44-b542-62d10e211869-multus-daemon-config\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb7ceb8-d2df-49b4-9365-0b56346f3076-tmp\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.275666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-sys-fs\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-kubernetes\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-var-lib-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-host-slash\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98dee2b9-71ba-4c44-b542-62d10e211869-multus-conf-dir\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0eb7ceb8-d2df-49b4-9365-0b56346f3076-lib-modules\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0070a-1d3a-4825-a0c3-96e51fa60e1b-konnectivity-ca\") pod \"konnectivity-agent-dgxkz\" (UID: \"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b\") " pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.166737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98dee2b9-71ba-4c44-b542-62d10e211869-multus-daemon-config\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.167317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0eb7ceb8-d2df-49b4-9365-0b56346f3076-etc-tuned\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.167678    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6cf0070a-1d3a-4825-a0c3-96e51fa60e1b-agent-certs\") pod \"konnectivity-agent-dgxkz\" (UID: \"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b\") " pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.168599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0eb7ceb8-d2df-49b4-9365-0b56346f3076-tmp\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.184567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jx4n\" (UniqueName: \"kubernetes.io/projected/0eb7ceb8-d2df-49b4-9365-0b56346f3076-kube-api-access-5jx4n\") pod \"tuned-fz8k4\" (UID: \"0eb7ceb8-d2df-49b4-9365-0b56346f3076\") " pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.184804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvrrs\" (UniqueName: \"kubernetes.io/projected/5d69539e-a2c9-4dec-9b69-e0d24f8c59aa-kube-api-access-jvrrs\") pod \"node-ca-gtnzm\" (UID: \"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa\") " pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.186304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7jt\" (UniqueName: \"kubernetes.io/projected/7f2587ff-aeec-4506-8144-77bc9d01c0a8-kube-api-access-2z7jt\") pod \"node-resolver-ms2rz\" (UID: \"7f2587ff-aeec-4506-8144-77bc9d01c0a8\") " pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.186426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvchx\" (UniqueName: \"kubernetes.io/projected/751718d9-c6df-4efb-b106-7f76115ae0cc-kube-api-access-qvchx\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.276359 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.187645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvs94\" (UniqueName: \"kubernetes.io/projected/d4e90515-cdbd-4edc-8d44-7b84e6cb23a9-kube-api-access-vvs94\") pod \"iptables-alerter-jdcsc\" (UID: \"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9\") " pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.187986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjsc\" (UniqueName: \"kubernetes.io/projected/a1aed1c5-b2db-4dfe-ad24-69c84710dde4-kube-api-access-jdjsc\") pod \"aws-ebs-csi-driver-node-qdpxk\" (UID: \"a1aed1c5-b2db-4dfe-ad24-69c84710dde4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.188317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcs7\" (UniqueName: \"kubernetes.io/projected/dfe390d0-f145-4d5c-bdfc-492b0b1a9933-kube-api-access-jjcs7\") pod \"multus-additional-cni-plugins-9hzt2\" (UID: \"dfe390d0-f145-4d5c-bdfc-492b0b1a9933\") " pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.188356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpklz\" (UniqueName: \"kubernetes.io/projected/98dee2b9-71ba-4c44-b542-62d10e211869-kube-api-access-kpklz\") pod \"multus-79r87\" (UID: \"98dee2b9-71ba-4c44-b542-62d10e211869\") " pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.266832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovn-node-metrics-cert\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.266877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-cni-netd\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.266901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glj7l\" (UniqueName: \"kubernetes.io/projected/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-kube-api-access-glj7l\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.266968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-slash\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.266998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovnkube-script-lib\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.267021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-etc-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.267081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-slash\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.266963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-cni-netd\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.267243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-etc-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.267597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovnkube-script-lib\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.277273 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovnkube-config\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6672fb14-fb97-4899-b368-e55e1a7b6c20-kubelet-config\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-var-lib-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.268217    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-node-log\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-env-overrides\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.268288    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:27.768269303 +0000 UTC m=+3.152468204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-systemd-units\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-cni-bin\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268560    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovnkube-config\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-env-overrides\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6672fb14-fb97-4899-b368-e55e1a7b6c20-kubelet-config\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-systemd\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-log-socket\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-ovn\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6672fb14-fb97-4899-b368-e55e1a7b6c20-dbus\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-kubelet\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.268925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-run-netns\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-node-log\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269064    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-systemd-units\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-log-socket\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.278962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6672fb14-fb97-4899-b368-e55e1a7b6c20-dbus\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-ovn\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269274    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-cni-bin\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-run-systemd\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-run-netns\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-host-kubelet\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-var-lib-openvswitch\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.269807    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-ovn-node-metrics-cert\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.278425    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.278453    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.278473    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:27.279576 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.278547    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:27.778527613 +0000 UTC m=+3.162726515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:27.282098 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.282055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glj7l\" (UniqueName: \"kubernetes.io/projected/16d7675a-9e52-4d99-9f9c-f3fd453c25a1-kube-api-access-glj7l\") pod \"ovnkube-node-r9lrl\" (UID: \"16d7675a-9e52-4d99-9f9c-f3fd453c25a1\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.290608 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.290581    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jdcsc"
Jul 10 13:50:27.312641 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.312597    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e90515_cdbd_4edc_8d44_7b84e6cb23a9.slice/crio-4c80ba6a8990c27904471fbe78144ffdd0546a24a7d82fe4a3a67827707fa6a8 WatchSource:0}: Error finding container 4c80ba6a8990c27904471fbe78144ffdd0546a24a7d82fe4a3a67827707fa6a8: Status 404 returned error can't find the container with id 4c80ba6a8990c27904471fbe78144ffdd0546a24a7d82fe4a3a67827707fa6a8
Jul 10 13:50:27.343930 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.343896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9hzt2"
Jul 10 13:50:27.355815 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.355785    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe390d0_f145_4d5c_bdfc_492b0b1a9933.slice/crio-be1b5332f10833665657913ad2ed674623b50ef7a854a111f9968fd6bc25f85a WatchSource:0}: Error finding container be1b5332f10833665657913ad2ed674623b50ef7a854a111f9968fd6bc25f85a: Status 404 returned error can't find the container with id be1b5332f10833665657913ad2ed674623b50ef7a854a111f9968fd6bc25f85a
Jul 10 13:50:27.359766 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.359728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gtnzm"
Jul 10 13:50:27.368282 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.368252    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-79r87"
Jul 10 13:50:27.375941 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.375742    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ms2rz"
Jul 10 13:50:27.378712 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.378675    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dee2b9_71ba_4c44_b542_62d10e211869.slice/crio-a305bf87bf720dd6df124184462e59bc996ee338a7ebe608263421045aa020c5 WatchSource:0}: Error finding container a305bf87bf720dd6df124184462e59bc996ee338a7ebe608263421045aa020c5: Status 404 returned error can't find the container with id a305bf87bf720dd6df124184462e59bc996ee338a7ebe608263421045aa020c5
Jul 10 13:50:27.382473 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.382443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fz8k4"
Jul 10 13:50:27.387326 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.387298    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2587ff_aeec_4506_8144_77bc9d01c0a8.slice/crio-b3dd2611736b9d8f6907d513ccaf57eae0bb07b6af9a3bb787164d51168030f7 WatchSource:0}: Error finding container b3dd2611736b9d8f6907d513ccaf57eae0bb07b6af9a3bb787164d51168030f7: Status 404 returned error can't find the container with id b3dd2611736b9d8f6907d513ccaf57eae0bb07b6af9a3bb787164d51168030f7
Jul 10 13:50:27.389840 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.389731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:27.392518 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.392480    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb7ceb8_d2df_49b4_9365_0b56346f3076.slice/crio-dfb8af4d728f67b541aa1b98e9e73213f17e3cd998f86e4c44cfeb20d8f318b9 WatchSource:0}: Error finding container dfb8af4d728f67b541aa1b98e9e73213f17e3cd998f86e4c44cfeb20d8f318b9: Status 404 returned error can't find the container with id dfb8af4d728f67b541aa1b98e9e73213f17e3cd998f86e4c44cfeb20d8f318b9
Jul 10 13:50:27.398068 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.398015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk"
Jul 10 13:50:27.399565 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.399533    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf0070a_1d3a_4825_a0c3_96e51fa60e1b.slice/crio-8676d8fe8668fc0294df73ec60baf276d3f79a274cad7f0bbb3542f71d732275 WatchSource:0}: Error finding container 8676d8fe8668fc0294df73ec60baf276d3f79a274cad7f0bbb3542f71d732275: Status 404 returned error can't find the container with id 8676d8fe8668fc0294df73ec60baf276d3f79a274cad7f0bbb3542f71d732275
Jul 10 13:50:27.403920 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.403900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:27.413279 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.413242    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1aed1c5_b2db_4dfe_ad24_69c84710dde4.slice/crio-c09762459c6b0ba5a80a8eff8da9f2ff3aa1383b45443a07ddb46717b2cb1768 WatchSource:0}: Error finding container c09762459c6b0ba5a80a8eff8da9f2ff3aa1383b45443a07ddb46717b2cb1768: Status 404 returned error can't find the container with id c09762459c6b0ba5a80a8eff8da9f2ff3aa1383b45443a07ddb46717b2cb1768
Jul 10 13:50:27.672156 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.672058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:27.672317 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.672225    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:27.672317 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.672302    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:50:28.672282982 +0000 UTC m=+4.056481881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:27.773393 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.773347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:27.773588 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.773502    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:27.773588 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.773585    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:28.773559613 +0000 UTC m=+4.157758520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:27.808498 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.808463    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 13:50:27.821481 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:50:27.821452    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d7675a_9e52_4d99_9f9c_f3fd453c25a1.slice/crio-4f00af183f5407a6279adead6b0d85e23d5f8431ed039b1a1c17e721c9dda594 WatchSource:0}: Error finding container 4f00af183f5407a6279adead6b0d85e23d5f8431ed039b1a1c17e721c9dda594: Status 404 returned error can't find the container with id 4f00af183f5407a6279adead6b0d85e23d5f8431ed039b1a1c17e721c9dda594
Jul 10 13:50:27.874636 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:27.874602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:27.874809 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.874787    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:27.874885 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.874819    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:27.874885 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.874833    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:27.874998 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:27.874896    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:28.874880912 +0000 UTC m=+4.259079812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:28.072665 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.072517    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 13:45:27 +0000 UTC" deadline="2028-03-02 09:14:56.46040241 +0000 UTC"
Jul 10 13:50:28.072665 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.072558    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14419h24m28.387848799s"
Jul 10 13:50:28.137650 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.137514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:28.137650 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.137647    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:28.152355 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.151893    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fz8k4" event={"ID":"0eb7ceb8-d2df-49b4-9365-0b56346f3076","Type":"ContainerStarted","Data":"dfb8af4d728f67b541aa1b98e9e73213f17e3cd998f86e4c44cfeb20d8f318b9"}
Jul 10 13:50:28.154226 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.154140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jdcsc" event={"ID":"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9","Type":"ContainerStarted","Data":"4c80ba6a8990c27904471fbe78144ffdd0546a24a7d82fe4a3a67827707fa6a8"}
Jul 10 13:50:28.158070 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.157938    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"4f00af183f5407a6279adead6b0d85e23d5f8431ed039b1a1c17e721c9dda594"}
Jul 10 13:50:28.159960 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.159864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk" event={"ID":"a1aed1c5-b2db-4dfe-ad24-69c84710dde4","Type":"ContainerStarted","Data":"c09762459c6b0ba5a80a8eff8da9f2ff3aa1383b45443a07ddb46717b2cb1768"}
Jul 10 13:50:28.164610 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.164579    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dgxkz" event={"ID":"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b","Type":"ContainerStarted","Data":"8676d8fe8668fc0294df73ec60baf276d3f79a274cad7f0bbb3542f71d732275"}
Jul 10 13:50:28.167145 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.167101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ms2rz" event={"ID":"7f2587ff-aeec-4506-8144-77bc9d01c0a8","Type":"ContainerStarted","Data":"b3dd2611736b9d8f6907d513ccaf57eae0bb07b6af9a3bb787164d51168030f7"}
Jul 10 13:50:28.176452 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.175751    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-79r87" event={"ID":"98dee2b9-71ba-4c44-b542-62d10e211869","Type":"ContainerStarted","Data":"a305bf87bf720dd6df124184462e59bc996ee338a7ebe608263421045aa020c5"}
Jul 10 13:50:28.188029 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.187917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gtnzm" event={"ID":"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa","Type":"ContainerStarted","Data":"c7ba938da3cdba1c52b7cbfb7a751a17bd19311a969619e5d291f0f14ac9acc2"}
Jul 10 13:50:28.193163 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.193127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerStarted","Data":"be1b5332f10833665657913ad2ed674623b50ef7a854a111f9968fd6bc25f85a"}
Jul 10 13:50:28.686632 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.686531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:28.687416 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.686718    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:28.687416 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.686828    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:50:30.686769462 +0000 UTC m=+6.070968363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:28.787898 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.787854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:28.788177 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.788054    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:28.788177 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.788147    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:30.788124534 +0000 UTC m=+6.172323436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:28.889875 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:28.889145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:28.889875 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.889392    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:28.889875 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.889414    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:28.889875 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.889427    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:28.889875 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:28.889490    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:30.889469876 +0000 UTC m=+6.273668778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:29.073477 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:29.073301    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 13:45:27 +0000 UTC" deadline="2028-02-18 13:01:20.583985757 +0000 UTC"
Jul 10 13:50:29.073477 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:29.073370    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14111h10m51.510621043s"
Jul 10 13:50:29.139361 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:29.138518    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:29.139361 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:29.138655    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:29.139361 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:29.139071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:29.139361 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:29.139193    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:29.209857 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:29.209777    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal" event={"ID":"17c2bdf5eafc896f76b1a9769b40bfcb","Type":"ContainerStarted","Data":"f28634ff49de9209e88f8b9ddeffe5e862f67be16b36b71b762f26e7a027de9b"}
Jul 10 13:50:30.137053 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:30.136636    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:30.137053 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.136753    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:30.223942 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:30.223800    2561 generic.go:356] "Generic (PLEG): container finished" podID="17c2bdf5eafc896f76b1a9769b40bfcb" containerID="f28634ff49de9209e88f8b9ddeffe5e862f67be16b36b71b762f26e7a027de9b" exitCode=0
Jul 10 13:50:30.223942 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:30.223864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal" event={"ID":"17c2bdf5eafc896f76b1a9769b40bfcb","Type":"ContainerDied","Data":"f28634ff49de9209e88f8b9ddeffe5e862f67be16b36b71b762f26e7a027de9b"}
Jul 10 13:50:30.704867 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:30.704200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:30.704867 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.704409    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:30.704867 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.704485    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:50:34.704462363 +0000 UTC m=+10.088661266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:30.805572 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:30.805530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:30.806360 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.805849    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:30.806360 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.805924    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:34.805902171 +0000 UTC m=+10.190101096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:30.906053 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:30.906013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:30.906295 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.906273    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:30.906372 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.906306    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:30.906372 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.906322    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:30.906489 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:30.906470    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:34.906371107 +0000 UTC m=+10.290570010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:31.136142 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:31.136040    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:31.136305 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:31.136209    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:31.136736 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:31.136710    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:31.136857 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:31.136833    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:32.136008 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:32.135975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:32.136505 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:32.136144    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:33.136526 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:33.136409    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:33.136984 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:33.136551    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:33.136984 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:33.136934    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:33.137132 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:33.137034    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:34.136181 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:34.136092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:34.136355 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.136252    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:34.738230 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:34.738192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:34.738690 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.738415    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:34.738690 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.738483    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:50:42.738463885 +0000 UTC m=+18.122662788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:34.839260 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:34.839223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:34.839407 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.839351    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:34.839474 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.839432    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:42.83940985 +0000 UTC m=+18.223608748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:34.940554 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:34.940511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:34.940707 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.940687    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:34.940790 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.940715    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:34.940790 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.940728    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:34.940874 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:34.940794    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:42.94077471 +0000 UTC m=+18.324973610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:35.138490 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:35.137718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:35.138490 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:35.137830    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:35.138490 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:35.138300    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:35.138490 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:35.138395    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:36.136711 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:36.136676    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:36.137199 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:36.136820    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:37.135985 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:37.135953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:37.136164 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:37.136084    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:37.136164 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:37.136143    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:37.136295 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:37.136254    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:38.136335 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:38.136254    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:38.136767 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:38.136372    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:39.136629 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:39.136499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:39.136629 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:39.136530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:39.137141 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:39.136642    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:39.137141 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:39.136771    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:40.136168 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:40.136132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:40.136355 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:40.136269    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:41.136365 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:41.136321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:41.136778 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:41.136321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:41.136778 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:41.136463    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:41.136778 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:41.136517    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:42.136438 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:42.136402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:42.136890 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:42.136516    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:42.800443 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:42.800405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:42.800634 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:42.800578    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:42.800694 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:42.800659    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:50:58.800636707 +0000 UTC m=+34.184835617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:42.901692 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:42.901657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:42.901896 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:42.901836    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:42.901959 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:42.901914    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:58.901893706 +0000 UTC m=+34.286092603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:43.002984 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:43.002949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:43.003191 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:43.003107    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:43.003191 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:43.003127    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:43.003191 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:43.003138    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:43.003338 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:43.003198    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:50:59.003181195 +0000 UTC m=+34.387380095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:43.136154 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:43.136072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:43.136154 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:43.136105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:43.136351 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:43.136191    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:43.136351 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:43.136309    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:44.136320 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:44.136285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:44.136709 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:44.136408    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:45.137726 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:45.137684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:45.138171 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:45.137804    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:45.138171 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:45.137858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:45.138171 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:45.137995    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:46.136195 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:46.136162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:46.136361 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:46.136290    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:47.136867 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.136399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:47.136867 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:47.136643    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:47.136867 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.136708    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:47.136867 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:47.136788    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:47.258667 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.258622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal" event={"ID":"1452b6b6e59b37d37fbed58ab4b2c18d","Type":"ContainerStarted","Data":"aa7256e6f4fa77c7f7138fbf9e825d9612d22925cc12e71b3e04b4d744fa8426"}
Jul 10 13:50:47.260452 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.260412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk" event={"ID":"a1aed1c5-b2db-4dfe-ad24-69c84710dde4","Type":"ContainerStarted","Data":"d213ea8366f272eff034bd12c1bbef88cf53bd85071b4b71fcc854faf4648d50"}
Jul 10 13:50:47.261928 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.261903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dgxkz" event={"ID":"6cf0070a-1d3a-4825-a0c3-96e51fa60e1b","Type":"ContainerStarted","Data":"a6b298116b57c808a2ca4efd5930ca7c0f2980d0c9efdbfe2822a8c1be6c59ea"}
Jul 10 13:50:47.264232 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.263696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ms2rz" event={"ID":"7f2587ff-aeec-4506-8144-77bc9d01c0a8","Type":"ContainerStarted","Data":"68d17200770ae64fdfdae18e87f6246febf30b097dc69b9212f3be7784b06296"}
Jul 10 13:50:47.265659 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.265410    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-79r87" event={"ID":"98dee2b9-71ba-4c44-b542-62d10e211869","Type":"ContainerStarted","Data":"8af36c08d659dc8883da231fa8e8f6049c05d25a24932c5e2e3e7806ef253b08"}
Jul 10 13:50:47.267067 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.267018    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gtnzm" event={"ID":"5d69539e-a2c9-4dec-9b69-e0d24f8c59aa","Type":"ContainerStarted","Data":"3a7ae38699412fe2b266cdf5389b473bcbcf0b2e76f885053d9d54e9b2f64048"}
Jul 10 13:50:47.269176 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.269150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerStarted","Data":"baeed375c52ad99f74429b119cf1b750941d6e0d1f04d1b4b5efd1345724666c"}
Jul 10 13:50:47.271642 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.271572    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal" event={"ID":"17c2bdf5eafc896f76b1a9769b40bfcb","Type":"ContainerStarted","Data":"39802378c351778cee354e4df2caad18fd924b1030ed10186a9d3f1e915a7feb"}
Jul 10 13:50:47.274093 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.274067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fz8k4" event={"ID":"0eb7ceb8-d2df-49b4-9365-0b56346f3076","Type":"ContainerStarted","Data":"611f38f0bfc7530f2d7d929ab6a37738ba0c45670bbe5a030174cf4781251385"}
Jul 10 13:50:47.277124 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.277066    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-218.ec2.internal" podStartSLOduration=21.277030747 podStartE2EDuration="21.277030747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.276989632 +0000 UTC m=+22.661188552" watchObservedRunningTime="2026-07-10 13:50:47.277030747 +0000 UTC m=+22.661229667"
Jul 10 13:50:47.326963 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.326907    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-218.ec2.internal" podStartSLOduration=21.326882528 podStartE2EDuration="21.326882528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.296581293 +0000 UTC m=+22.680780213" watchObservedRunningTime="2026-07-10 13:50:47.326882528 +0000 UTC m=+22.711081448"
Jul 10 13:50:47.341778 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.341723    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gtnzm" podStartSLOduration=2.778701012 podStartE2EDuration="22.341705782s" totalImagesPullingTime="19.56300477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.341459585 +0000 UTC m=+22.725658506" watchObservedRunningTime="2026-07-10 13:50:47.341705782 +0000 UTC m=+22.725904702"
Jul 10 13:50:47.359438 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.359224    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ms2rz" podStartSLOduration=11.096782217 podStartE2EDuration="22.359035974s" totalImagesPullingTime="11.262253757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.358180831 +0000 UTC m=+22.742379777" watchObservedRunningTime="2026-07-10 13:50:47.359035974 +0000 UTC m=+22.743234901"
Jul 10 13:50:47.380251 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.380209    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fz8k4" podStartSLOduration=2.836180038 podStartE2EDuration="22.380193377s" totalImagesPullingTime="19.544013339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.380018688 +0000 UTC m=+22.764217608" watchObservedRunningTime="2026-07-10 13:50:47.380193377 +0000 UTC m=+22.764392296"
Jul 10 13:50:47.397725 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.397670    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dgxkz" podStartSLOduration=11.147907264 podStartE2EDuration="22.397653254s" totalImagesPullingTime="11.24974599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.396781542 +0000 UTC m=+22.780980460" watchObservedRunningTime="2026-07-10 13:50:47.397653254 +0000 UTC m=+22.781852173"
Jul 10 13:50:47.416642 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:47.416583    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-79r87" podStartSLOduration=2.821878588 podStartE2EDuration="22.416560759s" totalImagesPullingTime="19.594682171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:47.416528532 +0000 UTC m=+22.800727450" watchObservedRunningTime="2026-07-10 13:50:47.416560759 +0000 UTC m=+22.800759680"
Jul 10 13:50:48.136591 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.136559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:48.136819 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:48.136671    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:48.279394 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.279358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"33d25da9d2cea623fdef8104b233c90ff67cac62a902783f95a2fc58ae65b84d"}
Jul 10 13:50:48.280222 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.279435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"f2897ccdd11c5abaac19fc3c64279dd4c4e72bab7849b45e38454fa1cc44993f"}
Jul 10 13:50:48.280222 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.279481    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"d268c9b9e7ab81ced687dc9b6814cc0b7b9be0f5485b1edf1b9735b5a8debaff"}
Jul 10 13:50:48.280222 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.279514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"0ae016b8faee4742cbc2c4423becfbe3b89f55779b82febcd4daa0410081e8f8"}
Jul 10 13:50:48.280222 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.279545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"dc8d2d9218644f109b5ebbfb7a06b6b99dc88cbed9f7ab1422a323ba1934e3e8"}
Jul 10 13:50:48.280222 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.279581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"3411ba870699dde50a8a73f87d318e1742182b320454e4b2de3966b0f38c1885"}
Jul 10 13:50:48.280732 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.280712    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe390d0-f145-4d5c-bdfc-492b0b1a9933" containerID="baeed375c52ad99f74429b119cf1b750941d6e0d1f04d1b4b5efd1345724666c" exitCode=0
Jul 10 13:50:48.280818 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.280794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerDied","Data":"baeed375c52ad99f74429b119cf1b750941d6e0d1f04d1b4b5efd1345724666c"}
Jul 10 13:50:48.282250 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.282197    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jdcsc" event={"ID":"d4e90515-cdbd-4edc-8d44-7b84e6cb23a9","Type":"ContainerStarted","Data":"1cbceb4fd60e6535ce47af4801795c83060583f88d63ae101f2f458d6fe8dd1a"}
Jul 10 13:50:48.322945 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.322890    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jdcsc" podStartSLOduration=3.7013376989999998 podStartE2EDuration="23.322875154s" totalImagesPullingTime="19.621537455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:48.322321076 +0000 UTC m=+23.706519995" watchObservedRunningTime="2026-07-10 13:50:48.322875154 +0000 UTC m=+23.707074072"
Jul 10 13:50:48.468274 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:48.468249    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 13:50:49.092976 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.092858    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T13:50:48.468267092Z","UUID":"342d5447-89dd-4cc1-85a6-38fba7de1023","Handler":null,"Name":"","Endpoint":""}
Jul 10 13:50:49.094655 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.094632    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 13:50:49.094770 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.094670    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 13:50:49.135844 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.135807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:49.136030 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:49.135922    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:49.136030 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.136012    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:49.136182 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:49.136109    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:49.287679 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.287641    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk" event={"ID":"a1aed1c5-b2db-4dfe-ad24-69c84710dde4","Type":"ContainerStarted","Data":"aca1bc61e24d5d170c9270c9965de925ad5d3643945735b5cbf6ca5fb468b8ed"}
Jul 10 13:50:49.892022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.891990    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:49.893124 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:49.893102    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:50.135892 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:50.135809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:50.136042 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:50.135937    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:50.293535 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:50.293493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"e62e9098765fc65276d75672601bc8b6f659870fea09298a68108b5371ef73d9"}
Jul 10 13:50:50.295853 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:50.295825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk" event={"ID":"a1aed1c5-b2db-4dfe-ad24-69c84710dde4","Type":"ContainerStarted","Data":"a2cb63d000615fbd03e0e2a0808bc4773fc73794913e4fc588f58a2a73de09b5"}
Jul 10 13:50:50.316847 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:50.316786    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdpxk" podStartSLOduration=2.393379322 podStartE2EDuration="24.316763467s" totalImagesPullingTime="21.923384145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:50.316330077 +0000 UTC m=+25.700529006" watchObservedRunningTime="2026-07-10 13:50:50.316763467 +0000 UTC m=+25.700962385"
Jul 10 13:50:51.136145 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:51.135951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:51.136363 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:51.135951    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:51.136363 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:51.136227    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:51.136363 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:51.136317    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:52.136434 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:52.136403    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:52.137024 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:52.136529    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:53.135987 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.135799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:53.136217 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.135809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:53.136217 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:53.136098    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:53.136217 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:53.136152    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:53.307347 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.307263    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" event={"ID":"16d7675a-9e52-4d99-9f9c-f3fd453c25a1","Type":"ContainerStarted","Data":"7cf554dfe88780dd77350b2c733bbbfc624119246f688d344af8bc6b796a2969"}
Jul 10 13:50:53.308021 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.307502    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:53.308021 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.307573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:53.309203 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.309177    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe390d0-f145-4d5c-bdfc-492b0b1a9933" containerID="f90ba8d11445ebfaed0c912c8d1017f5c465f16f70e30bc3bfb27203669c9b58" exitCode=0
Jul 10 13:50:53.309305 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.309223    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerDied","Data":"f90ba8d11445ebfaed0c912c8d1017f5c465f16f70e30bc3bfb27203669c9b58"}
Jul 10 13:50:53.323430 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.323406    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:53.341276 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:53.341225    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl" podStartSLOduration=7.933025927 podStartE2EDuration="27.341209887s" totalImagesPullingTime="19.40818396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:50:53.340994344 +0000 UTC m=+28.725193265" watchObservedRunningTime="2026-07-10 13:50:53.341209887 +0000 UTC m=+28.725408806"
Jul 10 13:50:54.136112 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.136010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:54.136337 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:54.136157    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:54.311765 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.311734    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:54.328358 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.328334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:50:54.761291 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.761032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qkdpl"]
Jul 10 13:50:54.761430 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.761332    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:54.761430 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:54.761420    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:54.767313 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.767279    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pjvbd"]
Jul 10 13:50:54.767533 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.767413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:54.767533 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:54.767515    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:54.767951 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.767929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-297nd"]
Jul 10 13:50:54.768022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:54.768014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:54.768138 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:54.768118    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:55.315971 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:55.315932    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe390d0-f145-4d5c-bdfc-492b0b1a9933" containerID="cdb42c7b83768dc5c4a00ceecd7eb6998de18c6cc51b5904408eb19b0d77aebd" exitCode=0
Jul 10 13:50:55.316373 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:55.316026    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerDied","Data":"cdb42c7b83768dc5c4a00ceecd7eb6998de18c6cc51b5904408eb19b0d77aebd"}
Jul 10 13:50:55.467311 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:55.467277    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:55.467497 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:55.467402    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 13:50:55.467888 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:55.467872    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dgxkz"
Jul 10 13:50:56.136235 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:56.136206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:56.136235 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:56.136221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:56.136235 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:56.136206    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:56.136519 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:56.136320    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:56.136519 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:56.136383    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:56.136519 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:56.136445    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:56.321544 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:56.321507    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe390d0-f145-4d5c-bdfc-492b0b1a9933" containerID="70c6071b5fd148dee5c64300d69aa92320f240c8e721f8dbbf8778e4a0593ab6" exitCode=0
Jul 10 13:50:56.322312 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:56.321585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerDied","Data":"70c6071b5fd148dee5c64300d69aa92320f240c8e721f8dbbf8778e4a0593ab6"}
Jul 10 13:50:58.136517 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:58.136482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:58.136517 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:58.136517    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:58.137110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:58.136526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:58.137110 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.136615    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-297nd" podUID="751718d9-c6df-4efb-b106-7f76115ae0cc"
Jul 10 13:50:58.137110 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.136694    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkdpl" podUID="6672fb14-fb97-4899-b368-e55e1a7b6c20"
Jul 10 13:50:58.137110 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.136760    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pjvbd" podUID="ff37438e-bcdc-499b-ac48-14e8c9ae3337"
Jul 10 13:50:58.830246 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:58.830200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:50:58.830437 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.830372    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:58.830491 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.830450    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs podName:751718d9-c6df-4efb-b106-7f76115ae0cc nodeName:}" failed. No retries permitted until 2026-07-10 13:51:30.830431805 +0000 UTC m=+66.214630706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs") pod "network-metrics-daemon-297nd" (UID: "751718d9-c6df-4efb-b106-7f76115ae0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 13:50:58.931602 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:58.931564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:50:58.931771 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.931689    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:58.931771 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:58.931752    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret podName:6672fb14-fb97-4899-b368-e55e1a7b6c20 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:30.931737886 +0000 UTC m=+66.315936782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret") pod "global-pull-secret-syncer-qkdpl" (UID: "6672fb14-fb97-4899-b368-e55e1a7b6c20") : object "kube-system"/"original-pull-secret" not registered
Jul 10 13:50:59.032828 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:59.032764    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:50:59.033012 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:59.032936    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 13:50:59.033012 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:59.032959    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 13:50:59.033012 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:59.032974    2561 projected.go:196] Error preparing data for projected volume kube-api-access-mg6dp for pod openshift-network-diagnostics/network-check-target-pjvbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:59.033182 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:50:59.033031    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp podName:ff37438e-bcdc-499b-ac48-14e8c9ae3337 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:31.033015219 +0000 UTC m=+66.417214123 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6dp" (UniqueName: "kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp") pod "network-check-target-pjvbd" (UID: "ff37438e-bcdc-499b-ac48-14e8c9ae3337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 13:50:59.896458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:59.896382    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-218.ec2.internal" event="NodeReady"
Jul 10 13:50:59.896815 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:59.896516    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 13:50:59.994599 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:50:59.994555    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4dvpf"]
Jul 10 13:51:00.003549 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.003521    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.008367 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.008303    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 13:51:00.008528 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.008410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9rbnh\""
Jul 10 13:51:00.008528 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.008517    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 13:51:00.009308 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.009289    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 13:51:00.019490 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.019426    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jdfjw"]
Jul 10 13:51:00.026089 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.026062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dvpf"]
Jul 10 13:51:00.026244 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.026179    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.029813 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.029779    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 13:51:00.029948 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.029891    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6zkp\""
Jul 10 13:51:00.032663 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.032640    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 13:51:00.048900 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.048866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jdfjw"]
Jul 10 13:51:00.135945 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.135897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:51:00.136204 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.136013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:51:00.136204 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.136024    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:51:00.139215 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.138817    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snqnd\""
Jul 10 13:51:00.139215 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139084    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 13:51:00.139426 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139291    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 13:51:00.139426 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139326    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 13:51:00.139746 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 13:51:00.139843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139735    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nwfk\""
Jul 10 13:51:00.139950 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058f1c2e-e879-4db1-8459-19ca17626c3f-tmp-dir\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.139999 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dca29636-30b6-454f-b9b9-686605b7a51a-cert\") pod \"ingress-canary-4dvpf\" (UID: \"dca29636-30b6-454f-b9b9-686605b7a51a\") " pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.139999 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.139993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/058f1c2e-e879-4db1-8459-19ca17626c3f-config-volume\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.140153 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.140135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6th6\" (UniqueName: \"kubernetes.io/projected/058f1c2e-e879-4db1-8459-19ca17626c3f-kube-api-access-j6th6\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.140216 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.140169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.140216 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.140210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7w9c\" (UniqueName: \"kubernetes.io/projected/dca29636-30b6-454f-b9b9-686605b7a51a-kube-api-access-q7w9c\") pod \"ingress-canary-4dvpf\" (UID: \"dca29636-30b6-454f-b9b9-686605b7a51a\") " pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.241393 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6th6\" (UniqueName: \"kubernetes.io/projected/058f1c2e-e879-4db1-8459-19ca17626c3f-kube-api-access-j6th6\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.241393 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241390    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.241634 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7w9c\" (UniqueName: \"kubernetes.io/projected/dca29636-30b6-454f-b9b9-686605b7a51a-kube-api-access-q7w9c\") pod \"ingress-canary-4dvpf\" (UID: \"dca29636-30b6-454f-b9b9-686605b7a51a\") " pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.241634 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058f1c2e-e879-4db1-8459-19ca17626c3f-tmp-dir\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.241634 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dca29636-30b6-454f-b9b9-686605b7a51a-cert\") pod \"ingress-canary-4dvpf\" (UID: \"dca29636-30b6-454f-b9b9-686605b7a51a\") " pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.241634 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/058f1c2e-e879-4db1-8459-19ca17626c3f-config-volume\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.241634 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:00.241500    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:51:00.241634 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:00.241574    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls podName:058f1c2e-e879-4db1-8459-19ca17626c3f nodeName:}" failed. No retries permitted until 2026-07-10 13:51:00.741551896 +0000 UTC m=+36.125750793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls") pod "dns-default-jdfjw" (UID: "058f1c2e-e879-4db1-8459-19ca17626c3f") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:00.241925 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.241820    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058f1c2e-e879-4db1-8459-19ca17626c3f-tmp-dir\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.242215 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.242035    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/058f1c2e-e879-4db1-8459-19ca17626c3f-config-volume\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.245823 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.245793    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dca29636-30b6-454f-b9b9-686605b7a51a-cert\") pod \"ingress-canary-4dvpf\" (UID: \"dca29636-30b6-454f-b9b9-686605b7a51a\") " pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.252684 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.252657    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7w9c\" (UniqueName: \"kubernetes.io/projected/dca29636-30b6-454f-b9b9-686605b7a51a-kube-api-access-q7w9c\") pod \"ingress-canary-4dvpf\" (UID: \"dca29636-30b6-454f-b9b9-686605b7a51a\") " pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.253241 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.253219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6th6\" (UniqueName: \"kubernetes.io/projected/058f1c2e-e879-4db1-8459-19ca17626c3f-kube-api-access-j6th6\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.315355 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.315318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dvpf"
Jul 10 13:51:00.521335 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.521268    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dvpf"]
Jul 10 13:51:00.548398 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:00.548362    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca29636_30b6_454f_b9b9_686605b7a51a.slice/crio-1caedfdd14756809c9226b93d7cd6ccd5a98d27e3d4e0dc7c0c1122b4649fbdd WatchSource:0}: Error finding container 1caedfdd14756809c9226b93d7cd6ccd5a98d27e3d4e0dc7c0c1122b4649fbdd: Status 404 returned error can't find the container with id 1caedfdd14756809c9226b93d7cd6ccd5a98d27e3d4e0dc7c0c1122b4649fbdd
Jul 10 13:51:00.744122 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:00.744086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:00.744270 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:00.744248    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:51:00.744328 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:00.744317    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls podName:058f1c2e-e879-4db1-8459-19ca17626c3f nodeName:}" failed. No retries permitted until 2026-07-10 13:51:01.744301658 +0000 UTC m=+37.128500555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls") pod "dns-default-jdfjw" (UID: "058f1c2e-e879-4db1-8459-19ca17626c3f") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:01.337384 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.337348    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe390d0-f145-4d5c-bdfc-492b0b1a9933" containerID="60701ad3f82c5733f7b17210f73d42813c93f151b9a5b1edf4424b6d2adc4f7d" exitCode=0
Jul 10 13:51:01.337840 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.337448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerDied","Data":"60701ad3f82c5733f7b17210f73d42813c93f151b9a5b1edf4424b6d2adc4f7d"}
Jul 10 13:51:01.338692 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.338659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dvpf" event={"ID":"dca29636-30b6-454f-b9b9-686605b7a51a","Type":"ContainerStarted","Data":"1caedfdd14756809c9226b93d7cd6ccd5a98d27e3d4e0dc7c0c1122b4649fbdd"}
Jul 10 13:51:01.750284 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.750190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:01.750284 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:01.750266    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:51:01.750470 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:01.750326    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls podName:058f1c2e-e879-4db1-8459-19ca17626c3f nodeName:}" failed. No retries permitted until 2026-07-10 13:51:03.750307915 +0000 UTC m=+39.134506813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls") pod "dns-default-jdfjw" (UID: "058f1c2e-e879-4db1-8459-19ca17626c3f") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:01.964840 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.964804    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rjgq9"]
Jul 10 13:51:01.979772 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.979739    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:01.983930 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.983901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rjgq9"]
Jul 10 13:51:01.984696 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.984674    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 13:51:01.985599 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.985575    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 13:51:01.986522 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.986460    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 10 13:51:01.986620 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.986604    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-snpl9\""
Jul 10 13:51:01.986674 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.986635    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 10 13:51:01.992913 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:01.992887    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 10 13:51:02.054669 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.052277    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-serving-cert\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.054669 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.052366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hskmb\" (UniqueName: \"kubernetes.io/projected/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-kube-api-access-hskmb\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.054669 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.052441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.054669 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.052498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-tmp\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.054669 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.052533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-snapshots\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.054669 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.052585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.153755 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.153712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.153937 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.153815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-tmp\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.153937 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.153849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-snapshots\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.153937 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.153887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.153937 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.153918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-serving-cert\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.154171 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.153965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hskmb\" (UniqueName: \"kubernetes.io/projected/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-kube-api-access-hskmb\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.154311 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.154279    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-tmp\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.154429 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.154394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.154530 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.154511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-snapshots\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.154870 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.154852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.157546 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.157417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-serving-cert\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.163864 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.163844    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hskmb\" (UniqueName: \"kubernetes.io/projected/8d7c57ff-c508-40ae-8b14-9e46b6f55ea3-kube-api-access-hskmb\") pod \"insights-operator-68d9dd94cf-rjgq9\" (UID: \"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3\") " pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.292469 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.292431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9"
Jul 10 13:51:02.344743 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.344706    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfe390d0-f145-4d5c-bdfc-492b0b1a9933" containerID="171837b91b625528bba3abc05ca06558a148108985bc1b070d8523b7abd8ac5c" exitCode=0
Jul 10 13:51:02.345184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:02.344763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerDied","Data":"171837b91b625528bba3abc05ca06558a148108985bc1b070d8523b7abd8ac5c"}
Jul 10 13:51:03.224023 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.223984    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rjgq9"]
Jul 10 13:51:03.229525 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:03.229483    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7c57ff_c508_40ae_8b14_9e46b6f55ea3.slice/crio-46bf5858893aca83a6ff43611f0a8b2c7afced892faf8fd11715d845eb4a8897 WatchSource:0}: Error finding container 46bf5858893aca83a6ff43611f0a8b2c7afced892faf8fd11715d845eb4a8897: Status 404 returned error can't find the container with id 46bf5858893aca83a6ff43611f0a8b2c7afced892faf8fd11715d845eb4a8897
Jul 10 13:51:03.349883 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.349590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dvpf" event={"ID":"dca29636-30b6-454f-b9b9-686605b7a51a","Type":"ContainerStarted","Data":"a291c4503f97cdf65acd24c49066fcad991a4064c0a6bc76646a614ce8707ffe"}
Jul 10 13:51:03.350753 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.350724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9" event={"ID":"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3","Type":"ContainerStarted","Data":"46bf5858893aca83a6ff43611f0a8b2c7afced892faf8fd11715d845eb4a8897"}
Jul 10 13:51:03.354480 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.354453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" event={"ID":"dfe390d0-f145-4d5c-bdfc-492b0b1a9933","Type":"ContainerStarted","Data":"9012db2640e878e145a4b3ac3b0a6be12f042812cec5f079ad73ca64204ff112"}
Jul 10 13:51:03.371981 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.371922    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4dvpf" podStartSLOduration=1.6914379149999998 podStartE2EDuration="4.371901282s" totalImagesPullingTime="2.680463367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:03.37109638 +0000 UTC m=+38.755295301" watchObservedRunningTime="2026-07-10 13:51:03.371901282 +0000 UTC m=+38.756100201"
Jul 10 13:51:03.442104 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.442027    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9hzt2" podStartSLOduration=8.232194485 podStartE2EDuration="38.442005475s" totalImagesPullingTime="30.20981099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:03.439900668 +0000 UTC m=+38.824099598" watchObservedRunningTime="2026-07-10 13:51:03.442005475 +0000 UTC m=+38.826204393"
Jul 10 13:51:03.768397 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:03.768316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:03.768538 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:03.768429    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:51:03.768538 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:03.768492    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls podName:058f1c2e-e879-4db1-8459-19ca17626c3f nodeName:}" failed. No retries permitted until 2026-07-10 13:51:07.76847758 +0000 UTC m=+43.152676477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls") pod "dns-default-jdfjw" (UID: "058f1c2e-e879-4db1-8459-19ca17626c3f") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:04.050201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.050121    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"]
Jul 10 13:51:04.062870 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.062840    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.065602 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.065558    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6k62w\""
Jul 10 13:51:04.065718 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.065697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"]
Jul 10 13:51:04.065871 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.065852    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 13:51:04.066504 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.066328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:51:04.066802 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.066751    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 13:51:04.172618 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.172583    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.172795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.172723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8bf\" (UniqueName: \"kubernetes.io/projected/8c89891b-536a-48af-b2b2-6aac4aad0ddd-kube-api-access-fs8bf\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.273355 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.273321    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8bf\" (UniqueName: \"kubernetes.io/projected/8c89891b-536a-48af-b2b2-6aac4aad0ddd-kube-api-access-fs8bf\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.273546 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.273368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.273546 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:04.273486    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 13:51:04.273636 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:04.273550    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls podName:8c89891b-536a-48af-b2b2-6aac4aad0ddd nodeName:}" failed. No retries permitted until 2026-07-10 13:51:04.773531441 +0000 UTC m=+40.157730342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls") pod "cluster-samples-operator-65db858894-lr59p" (UID: "8c89891b-536a-48af-b2b2-6aac4aad0ddd") : secret "samples-operator-tls" not found
Jul 10 13:51:04.285534 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.285508    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8bf\" (UniqueName: \"kubernetes.io/projected/8c89891b-536a-48af-b2b2-6aac4aad0ddd-kube-api-access-fs8bf\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.778664 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:04.778584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:04.779068 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:04.778723    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 13:51:04.779068 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:04.778788    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls podName:8c89891b-536a-48af-b2b2-6aac4aad0ddd nodeName:}" failed. No retries permitted until 2026-07-10 13:51:05.778773538 +0000 UTC m=+41.162972436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls") pod "cluster-samples-operator-65db858894-lr59p" (UID: "8c89891b-536a-48af-b2b2-6aac4aad0ddd") : secret "samples-operator-tls" not found
Jul 10 13:51:05.789115 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:05.789069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:05.789493 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:05.789192    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 13:51:05.789493 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:05.789276    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls podName:8c89891b-536a-48af-b2b2-6aac4aad0ddd nodeName:}" failed. No retries permitted until 2026-07-10 13:51:07.789256863 +0000 UTC m=+43.173455778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls") pod "cluster-samples-operator-65db858894-lr59p" (UID: "8c89891b-536a-48af-b2b2-6aac4aad0ddd") : secret "samples-operator-tls" not found
Jul 10 13:51:06.362690 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.362656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9" event={"ID":"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3","Type":"ContainerStarted","Data":"ef0b211bff1efde4a4b03c4e7ea6307e8b9bf5a8b1addf6f090d20f1fb3fbb64"}
Jul 10 13:51:06.383954 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.383898    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9" podStartSLOduration=3.017701461 podStartE2EDuration="5.383883067s" totalImagesPullingTime="2.366181606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:06.383035498 +0000 UTC m=+41.767234417" watchObservedRunningTime="2026-07-10 13:51:06.383883067 +0000 UTC m=+41.768081985"
Jul 10 13:51:06.910889 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.910845    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-65c5g"]
Jul 10 13:51:06.927676 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.927613    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:06.929344 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.929317    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-65c5g"]
Jul 10 13:51:06.931312 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.931288    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 13:51:06.931404 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.931294    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 13:51:06.932168 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:06.932147    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xrxqc\""
Jul 10 13:51:07.000210 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.000179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6cacac01-3507-4409-8daf-e2bee302c657-crio-socket\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.000210 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.000211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvbl\" (UniqueName: \"kubernetes.io/projected/6cacac01-3507-4409-8daf-e2bee302c657-kube-api-access-8kvbl\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.000409 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.000350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cacac01-3507-4409-8daf-e2bee302c657-data-volume\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.000409 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.000386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.000472 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.000407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.100885 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.100841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cacac01-3507-4409-8daf-e2bee302c657-data-volume\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.101077 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.100900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.101077 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.100930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.101077 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.101036    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.101184 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.101081    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.101184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.101090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6cacac01-3507-4409-8daf-e2bee302c657-crio-socket\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.101184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.101123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvbl\" (UniqueName: \"kubernetes.io/projected/6cacac01-3507-4409-8daf-e2bee302c657-kube-api-access-8kvbl\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.101184 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.101138    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:07.601121261 +0000 UTC m=+42.985320193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.101347 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.101256    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:07.601231985 +0000 UTC m=+42.985430898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.101347 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.101254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cacac01-3507-4409-8daf-e2bee302c657-data-volume\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.101347 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.101296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6cacac01-3507-4409-8daf-e2bee302c657-crio-socket\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.117417 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.117385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvbl\" (UniqueName: \"kubernetes.io/projected/6cacac01-3507-4409-8daf-e2bee302c657-kube-api-access-8kvbl\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.605692 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.605651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.605692 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.605693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:07.605913 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.605789    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.605913 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.605860    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:08.605844051 +0000 UTC m=+43.990042948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:07.605913 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.605807    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.606025 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.605918    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:08.605906863 +0000 UTC m=+43.990105760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:07.807681 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.807646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:07.807886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:07.807704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:07.807886 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.807803    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:51:07.807886 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.807819    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 13:51:07.807886 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.807855    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls podName:058f1c2e-e879-4db1-8459-19ca17626c3f nodeName:}" failed. No retries permitted until 2026-07-10 13:51:15.807841793 +0000 UTC m=+51.192040690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls") pod "dns-default-jdfjw" (UID: "058f1c2e-e879-4db1-8459-19ca17626c3f") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:07.807886 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:07.807887    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls podName:8c89891b-536a-48af-b2b2-6aac4aad0ddd nodeName:}" failed. No retries permitted until 2026-07-10 13:51:11.807869903 +0000 UTC m=+47.192068815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls") pod "cluster-samples-operator-65db858894-lr59p" (UID: "8c89891b-536a-48af-b2b2-6aac4aad0ddd") : secret "samples-operator-tls" not found
Jul 10 13:51:08.613695 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:08.613657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:08.613695 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:08.613696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:08.614210 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:08.613787    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:08.614210 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:08.613852    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:10.613837362 +0000 UTC m=+45.998036260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:08.614210 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:08.613915    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:08.614210 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:08.613986    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:10.613967556 +0000 UTC m=+45.998166454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:08.884085 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:08.883990    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ms2rz_7f2587ff-aeec-4506-8144-77bc9d01c0a8/dns-node-resolver/0.log"
Jul 10 13:51:09.688858 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:09.688828    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gtnzm_5d69539e-a2c9-4dec-9b69-e0d24f8c59aa/node-ca/0.log"
Jul 10 13:51:10.283956 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.283924    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dvpf_dca29636-30b6-454f-b9b9-686605b7a51a/serve-healthcheck-canary/0.log"
Jul 10 13:51:10.629276 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.629237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:10.629446 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.629289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:10.629446 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:10.629358    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:10.629446 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:10.629412    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:10.629446 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:10.629426    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:14.629407132 +0000 UTC m=+50.013606037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:10.629583 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:10.629449    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:14.629438805 +0000 UTC m=+50.013637703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:10.961024 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.960953    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"]
Jul 10 13:51:10.987891 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.987860    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"]
Jul 10 13:51:10.988064 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.987975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:10.990815 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.990793    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 10 13:51:10.991726 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.991704    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 10 13:51:10.991863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.991729    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 10 13:51:10.991863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.991758    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:51:10.991863 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:10.991820    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8kqqk\""
Jul 10 13:51:11.134034 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.133997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfnct\" (UniqueName: \"kubernetes.io/projected/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-kube-api-access-mfnct\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.134034 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.134035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-config\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.134316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.134199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.235358 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.235276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfnct\" (UniqueName: \"kubernetes.io/projected/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-kube-api-access-mfnct\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.235358 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.235313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-config\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.235565 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.235538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.235864 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.235847    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-config\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.237645 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.237627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.244914 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.244890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfnct\" (UniqueName: \"kubernetes.io/projected/68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c-kube-api-access-mfnct\") pod \"service-ca-operator-7695fc6c8c-ccf48\" (UID: \"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.297479 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.297437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"
Jul 10 13:51:11.458010 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.457979    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48"]
Jul 10 13:51:11.461225 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:11.461199    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c7e6a3_39e3_4a1d_8977_4b1e9bb07f9c.slice/crio-63d23a4889ec590acb8eca7b20c712f98cb9fb71de5d64886586f9058ad899af WatchSource:0}: Error finding container 63d23a4889ec590acb8eca7b20c712f98cb9fb71de5d64886586f9058ad899af: Status 404 returned error can't find the container with id 63d23a4889ec590acb8eca7b20c712f98cb9fb71de5d64886586f9058ad899af
Jul 10 13:51:11.839771 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:11.839731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:11.839947 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:11.839886    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 13:51:11.839947 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:11.839943    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls podName:8c89891b-536a-48af-b2b2-6aac4aad0ddd nodeName:}" failed. No retries permitted until 2026-07-10 13:51:19.839929954 +0000 UTC m=+55.224128854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls") pod "cluster-samples-operator-65db858894-lr59p" (UID: "8c89891b-536a-48af-b2b2-6aac4aad0ddd") : secret "samples-operator-tls" not found
Jul 10 13:51:12.010993 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.010963    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"]
Jul 10 13:51:12.028702 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.028668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"]
Jul 10 13:51:12.028844 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.028785    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"
Jul 10 13:51:12.032524 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.032488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gv22l\""
Jul 10 13:51:12.142080 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.141976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m8q4\" (UniqueName: \"kubernetes.io/projected/dff7da48-8731-4cdd-804b-08de61bb6bce-kube-api-access-4m8q4\") pod \"network-check-source-869dcfcdcd-262pn\" (UID: \"dff7da48-8731-4cdd-804b-08de61bb6bce\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"
Jul 10 13:51:12.242910 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.242871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m8q4\" (UniqueName: \"kubernetes.io/projected/dff7da48-8731-4cdd-804b-08de61bb6bce-kube-api-access-4m8q4\") pod \"network-check-source-869dcfcdcd-262pn\" (UID: \"dff7da48-8731-4cdd-804b-08de61bb6bce\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"
Jul 10 13:51:12.253019 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.252985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m8q4\" (UniqueName: \"kubernetes.io/projected/dff7da48-8731-4cdd-804b-08de61bb6bce-kube-api-access-4m8q4\") pod \"network-check-source-869dcfcdcd-262pn\" (UID: \"dff7da48-8731-4cdd-804b-08de61bb6bce\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"
Jul 10 13:51:12.337706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.337659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"
Jul 10 13:51:12.378909 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.378874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48" event={"ID":"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c","Type":"ContainerStarted","Data":"63d23a4889ec590acb8eca7b20c712f98cb9fb71de5d64886586f9058ad899af"}
Jul 10 13:51:12.496161 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.496122    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"]
Jul 10 13:51:12.501931 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:12.501900    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff7da48_8731_4cdd_804b_08de61bb6bce.slice/crio-1cfc170d91b0a66818c52058e99be95bb3bd708b02e4e3e972da909aa4118102 WatchSource:0}: Error finding container 1cfc170d91b0a66818c52058e99be95bb3bd708b02e4e3e972da909aa4118102: Status 404 returned error can't find the container with id 1cfc170d91b0a66818c52058e99be95bb3bd708b02e4e3e972da909aa4118102
Jul 10 13:51:12.515260 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.515230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn"]
Jul 10 13:51:12.515384 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.515340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.516065 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.516031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"]
Jul 10 13:51:12.518092 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.518073    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r8g5k\""
Jul 10 13:51:12.518437 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.518417    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 13:51:12.518854 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.518837    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 13:51:12.519321 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.519295    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 13:51:12.525556 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.525506    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 13:51:12.646573 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-registry-certificates\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646573 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-trusted-ca\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646790 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7rfm\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-kube-api-access-n7rfm\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646790 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-bound-sa-token\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646790 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646790 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-image-registry-private-configuration\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646790 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa5d00cb-447a-4fce-9340-da11823814c8-ca-trust-extracted\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.646790 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.646791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-installation-pull-secrets\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.747923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.747829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-registry-certificates\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.747923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.747874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-trusted-ca\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.747923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.747894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7rfm\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-kube-api-access-n7rfm\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748224 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-bound-sa-token\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748224 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748224 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-image-registry-private-configuration\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748224 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa5d00cb-447a-4fce-9340-da11823814c8-ca-trust-extracted\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748224 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748196    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-installation-pull-secrets\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748497 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:12.748226    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:51:12.748497 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:12.748244    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p: secret "image-registry-tls" not found
Jul 10 13:51:12.748497 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:12.748300    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls podName:aa5d00cb-447a-4fce-9340-da11823814c8 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:13.248281856 +0000 UTC m=+48.632480766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls") pod "image-registry-6f5b7fd4b5-kjg9p" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8") : secret "image-registry-tls" not found
Jul 10 13:51:12.748644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa5d00cb-447a-4fce-9340-da11823814c8-ca-trust-extracted\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-registry-certificates\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.748919 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.748901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-trusted-ca\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.750589 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.750572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-image-registry-private-configuration\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.750644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.750594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-installation-pull-secrets\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.757750 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.757725    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-bound-sa-token\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:12.757878 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:12.757789    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7rfm\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-kube-api-access-n7rfm\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:13.253094 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:13.253036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:13.253547 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:13.253235    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:51:13.253547 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:13.253249    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p: secret "image-registry-tls" not found
Jul 10 13:51:13.253547 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:13.253318    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls podName:aa5d00cb-447a-4fce-9340-da11823814c8 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:14.253297296 +0000 UTC m=+49.637496213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls") pod "image-registry-6f5b7fd4b5-kjg9p" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8") : secret "image-registry-tls" not found
Jul 10 13:51:13.383779 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:13.383738    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn" event={"ID":"dff7da48-8731-4cdd-804b-08de61bb6bce","Type":"ContainerStarted","Data":"1cfc170d91b0a66818c52058e99be95bb3bd708b02e4e3e972da909aa4118102"}
Jul 10 13:51:14.263493 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:14.263455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:14.263952 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.263696    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:51:14.263952 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.263717    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p: secret "image-registry-tls" not found
Jul 10 13:51:14.263952 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.263784    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls podName:aa5d00cb-447a-4fce-9340-da11823814c8 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:16.263763238 +0000 UTC m=+51.647962138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls") pod "image-registry-6f5b7fd4b5-kjg9p" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8") : secret "image-registry-tls" not found
Jul 10 13:51:14.388373 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:14.388293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48" event={"ID":"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c","Type":"ContainerStarted","Data":"c2191cf61ddd54e360f90e2908cf3446a5d014bf43e2992817e6a69e36d76ac1"}
Jul 10 13:51:14.407585 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:14.407530    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48" podStartSLOduration=1.779860492 podStartE2EDuration="4.407509157s" totalImagesPullingTime="2.627648665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:14.407186841 +0000 UTC m=+49.791385761" watchObservedRunningTime="2026-07-10 13:51:14.407509157 +0000 UTC m=+49.791708077"
Jul 10 13:51:14.668622 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:14.668535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:14.668791 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.668657    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 13:51:14.668791 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.668726    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:22.668706916 +0000 UTC m=+58.052905827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : configmap "kube-rbac-proxy" not found
Jul 10 13:51:14.668791 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.668735    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:14.668791 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:14.668770    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:22.668759425 +0000 UTC m=+58.052958324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:14.668791 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:14.668656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:15.880760 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:15.880723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:15.881114 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:15.880858    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 13:51:15.881114 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:15.880919    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls podName:058f1c2e-e879-4db1-8459-19ca17626c3f nodeName:}" failed. No retries permitted until 2026-07-10 13:51:31.880903621 +0000 UTC m=+67.265102518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls") pod "dns-default-jdfjw" (UID: "058f1c2e-e879-4db1-8459-19ca17626c3f") : secret "dns-default-metrics-tls" not found
Jul 10 13:51:16.283853 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:16.283815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:16.284041 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:16.283949    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:51:16.284041 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:16.283960    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p: secret "image-registry-tls" not found
Jul 10 13:51:16.284041 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:16.284008    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls podName:aa5d00cb-447a-4fce-9340-da11823814c8 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:20.283994797 +0000 UTC m=+55.668193694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls") pod "image-registry-6f5b7fd4b5-kjg9p" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8") : secret "image-registry-tls" not found
Jul 10 13:51:16.395784 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:16.395747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn" event={"ID":"dff7da48-8731-4cdd-804b-08de61bb6bce","Type":"ContainerStarted","Data":"d84199b7a1d783b73694bdc864befead1471a4f61607699ec0686cf8d83abba8"}
Jul 10 13:51:16.415565 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:16.415508    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-262pn" podStartSLOduration=2.13176647 podStartE2EDuration="5.415492409s" totalImagesPullingTime="3.283725939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:16.414352437 +0000 UTC m=+51.798551356" watchObservedRunningTime="2026-07-10 13:51:16.415492409 +0000 UTC m=+51.799691365"
Jul 10 13:51:19.914021 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:19.913983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:19.914489 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:19.914139    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 13:51:19.914489 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:19.914210    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls podName:8c89891b-536a-48af-b2b2-6aac4aad0ddd nodeName:}" failed. No retries permitted until 2026-07-10 13:51:35.914188423 +0000 UTC m=+71.298387350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls") pod "cluster-samples-operator-65db858894-lr59p" (UID: "8c89891b-536a-48af-b2b2-6aac4aad0ddd") : secret "samples-operator-tls" not found
Jul 10 13:51:20.316293 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:20.316263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:20.316448 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:20.316401    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 13:51:20.316448 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:20.316417    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p: secret "image-registry-tls" not found
Jul 10 13:51:20.316519 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:20.316467    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls podName:aa5d00cb-447a-4fce-9340-da11823814c8 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:28.316453703 +0000 UTC m=+63.700652600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls") pod "image-registry-6f5b7fd4b5-kjg9p" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8") : secret "image-registry-tls" not found
Jul 10 13:51:22.736981 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:22.736929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:22.737497 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:22.737008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:22.737497 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:22.737104    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:22.737497 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:51:22.737172    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls podName:6cacac01-3507-4409-8daf-e2bee302c657 nodeName:}" failed. No retries permitted until 2026-07-10 13:51:38.737155782 +0000 UTC m=+74.121354678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls") pod "insights-runtime-extractor-65c5g" (UID: "6cacac01-3507-4409-8daf-e2bee302c657") : secret "insights-runtime-extractor-tls" not found
Jul 10 13:51:22.737497 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:22.737490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6cacac01-3507-4409-8daf-e2bee302c657-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:26.332360 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:26.332334    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9lrl"
Jul 10 13:51:28.383646 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:28.383605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:28.385891 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:28.385868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"image-registry-6f5b7fd4b5-kjg9p\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") " pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:28.430223 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:28.430194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r8g5k\""
Jul 10 13:51:28.438522 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:28.438503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:28.570654 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:28.570590    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"]
Jul 10 13:51:28.573022 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:28.572989    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5d00cb_447a_4fce_9340_da11823814c8.slice/crio-3d15f317d7ba774c159d7da7f64dd9b121b4936159aca7acea1eb1501cb725a4 WatchSource:0}: Error finding container 3d15f317d7ba774c159d7da7f64dd9b121b4936159aca7acea1eb1501cb725a4: Status 404 returned error can't find the container with id 3d15f317d7ba774c159d7da7f64dd9b121b4936159aca7acea1eb1501cb725a4
Jul 10 13:51:29.428869 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:29.428836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" event={"ID":"aa5d00cb-447a-4fce-9340-da11823814c8","Type":"ContainerStarted","Data":"30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b"}
Jul 10 13:51:29.429267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:29.428883    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" event={"ID":"aa5d00cb-447a-4fce-9340-da11823814c8","Type":"ContainerStarted","Data":"3d15f317d7ba774c159d7da7f64dd9b121b4936159aca7acea1eb1501cb725a4"}
Jul 10 13:51:29.429267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:29.428918    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:51:29.454232 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:29.454180    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" podStartSLOduration=17.454162311 podStartE2EDuration="17.454162311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:29.452874249 +0000 UTC m=+64.837073168" watchObservedRunningTime="2026-07-10 13:51:29.454162311 +0000 UTC m=+64.838361229"
Jul 10 13:51:30.908714 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:30.908670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:51:30.914438 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:30.914417    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 13:51:30.921883 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:30.921860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/751718d9-c6df-4efb-b106-7f76115ae0cc-metrics-certs\") pod \"network-metrics-daemon-297nd\" (UID: \"751718d9-c6df-4efb-b106-7f76115ae0cc\") " pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:51:31.009386 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.009348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:51:31.019814 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.019788    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 13:51:31.032284 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.032248    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6672fb14-fb97-4899-b368-e55e1a7b6c20-original-pull-secret\") pod \"global-pull-secret-syncer-qkdpl\" (UID: \"6672fb14-fb97-4899-b368-e55e1a7b6c20\") " pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:51:31.054422 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.054385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkdpl"
Jul 10 13:51:31.063447 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.063418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nwfk\""
Jul 10 13:51:31.071105 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.071083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-297nd"
Jul 10 13:51:31.110609 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.110579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:51:31.113079 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.113034    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6dp\" (UniqueName: \"kubernetes.io/projected/ff37438e-bcdc-499b-ac48-14e8c9ae3337-kube-api-access-mg6dp\") pod \"network-check-target-pjvbd\" (UID: \"ff37438e-bcdc-499b-ac48-14e8c9ae3337\") " pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:51:31.230426 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.230389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qkdpl"]
Jul 10 13:51:31.234443 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:31.234409    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6672fb14_fb97_4899_b368_e55e1a7b6c20.slice/crio-fa47a5ec463afea771fc16213bbb6d8f6d19b845d2685c4bd2a8b096c217c719 WatchSource:0}: Error finding container fa47a5ec463afea771fc16213bbb6d8f6d19b845d2685c4bd2a8b096c217c719: Status 404 returned error can't find the container with id fa47a5ec463afea771fc16213bbb6d8f6d19b845d2685c4bd2a8b096c217c719
Jul 10 13:51:31.254755 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.254729    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-297nd"]
Jul 10 13:51:31.258109 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:31.258079    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751718d9_c6df_4efb_b106_7f76115ae0cc.slice/crio-fbe4b51ce599e4a6222c35c11172ffb5769c735fff9613619fa2ece927b018cc WatchSource:0}: Error finding container fbe4b51ce599e4a6222c35c11172ffb5769c735fff9613619fa2ece927b018cc: Status 404 returned error can't find the container with id fbe4b51ce599e4a6222c35c11172ffb5769c735fff9613619fa2ece927b018cc
Jul 10 13:51:31.350310 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.350274    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snqnd\""
Jul 10 13:51:31.357598 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.357581    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:51:31.436287 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.436031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-297nd" event={"ID":"751718d9-c6df-4efb-b106-7f76115ae0cc","Type":"ContainerStarted","Data":"fbe4b51ce599e4a6222c35c11172ffb5769c735fff9613619fa2ece927b018cc"}
Jul 10 13:51:31.437451 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.437423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qkdpl" event={"ID":"6672fb14-fb97-4899-b368-e55e1a7b6c20","Type":"ContainerStarted","Data":"fa47a5ec463afea771fc16213bbb6d8f6d19b845d2685c4bd2a8b096c217c719"}
Jul 10 13:51:31.516880 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.516856    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pjvbd"]
Jul 10 13:51:31.517802 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:31.517775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff37438e_bcdc_499b_ac48_14e8c9ae3337.slice/crio-9e1c8ae69770bd8751a037f6eb4ba0de80957305db43b95f75973a4519571fbc WatchSource:0}: Error finding container 9e1c8ae69770bd8751a037f6eb4ba0de80957305db43b95f75973a4519571fbc: Status 404 returned error can't find the container with id 9e1c8ae69770bd8751a037f6eb4ba0de80957305db43b95f75973a4519571fbc
Jul 10 13:51:31.918036 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.917996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:31.920889 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:31.920858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/058f1c2e-e879-4db1-8459-19ca17626c3f-metrics-tls\") pod \"dns-default-jdfjw\" (UID: \"058f1c2e-e879-4db1-8459-19ca17626c3f\") " pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:32.140563 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.140527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j6zkp\""
Jul 10 13:51:32.148042 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.147989    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:32.448845 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.448733    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jdfjw"]
Jul 10 13:51:32.450323 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.450277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pjvbd" event={"ID":"ff37438e-bcdc-499b-ac48-14e8c9ae3337","Type":"ContainerStarted","Data":"2ac5949a9f67df81909a87e26ba8c47514afd2448e880ff74635942688d99ec4"}
Jul 10 13:51:32.450443 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.450348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pjvbd" event={"ID":"ff37438e-bcdc-499b-ac48-14e8c9ae3337","Type":"ContainerStarted","Data":"9e1c8ae69770bd8751a037f6eb4ba0de80957305db43b95f75973a4519571fbc"}
Jul 10 13:51:32.450634 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.450561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:51:32.452393 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.452363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-297nd" event={"ID":"751718d9-c6df-4efb-b106-7f76115ae0cc","Type":"ContainerStarted","Data":"a063e928d7cf209742e1b204117f64cd62ad24f3d0947097f2e4afeac8f44d34"}
Jul 10 13:51:32.453081 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:32.453031    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058f1c2e_e879_4db1_8459_19ca17626c3f.slice/crio-cd5f752ea649faa882c2ec6352045b1221458d53daa7e3d2d0f6120df7981d06 WatchSource:0}: Error finding container cd5f752ea649faa882c2ec6352045b1221458d53daa7e3d2d0f6120df7981d06: Status 404 returned error can't find the container with id cd5f752ea649faa882c2ec6352045b1221458d53daa7e3d2d0f6120df7981d06
Jul 10 13:51:32.487034 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:32.486981    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pjvbd" podStartSLOduration=66.486961214 podStartE2EDuration="1m6.486961214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:32.486468077 +0000 UTC m=+67.870667000" watchObservedRunningTime="2026-07-10 13:51:32.486961214 +0000 UTC m=+67.871160174"
Jul 10 13:51:33.457387 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:33.457342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdfjw" event={"ID":"058f1c2e-e879-4db1-8459-19ca17626c3f","Type":"ContainerStarted","Data":"cd5f752ea649faa882c2ec6352045b1221458d53daa7e3d2d0f6120df7981d06"}
Jul 10 13:51:33.459351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:33.459321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-297nd" event={"ID":"751718d9-c6df-4efb-b106-7f76115ae0cc","Type":"ContainerStarted","Data":"3078a0cf3b49df41d31c5390537d5eb7f3083d20f61a4595f51730fe01195539"}
Jul 10 13:51:33.480037 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:33.479975    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-297nd" podStartSLOduration=67.434050102 podStartE2EDuration="1m8.479951329s" totalImagesPullingTime="1.045901227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:33.478736766 +0000 UTC m=+68.862935690" watchObservedRunningTime="2026-07-10 13:51:33.479951329 +0000 UTC m=+68.864150250"
Jul 10 13:51:35.952887 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:35.952831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:35.955242 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:35.955220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c89891b-536a-48af-b2b2-6aac4aad0ddd-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lr59p\" (UID: \"8c89891b-536a-48af-b2b2-6aac4aad0ddd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:36.178439 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.178401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6k62w\""
Jul 10 13:51:36.185951 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.185924    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"
Jul 10 13:51:36.320564 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.320534    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p"]
Jul 10 13:51:36.479060 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.479022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdfjw" event={"ID":"058f1c2e-e879-4db1-8459-19ca17626c3f","Type":"ContainerStarted","Data":"27fbabb74d855b99cbdc32671b791ad17a041b79ef1dfdd4d35d1dcdd98a1eab"}
Jul 10 13:51:36.479239 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.479106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:36.479239 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.479131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdfjw" event={"ID":"058f1c2e-e879-4db1-8459-19ca17626c3f","Type":"ContainerStarted","Data":"29a1a840e12cbe6721bc826dd155b01e2fc0e91434dfea5c436c86207f6b2419"}
Jul 10 13:51:36.480277 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.480250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p" event={"ID":"8c89891b-536a-48af-b2b2-6aac4aad0ddd","Type":"ContainerStarted","Data":"a011d9422f904c9e20a52a846c424300db3d1eec330a73c76c512f08cf3e752e"}
Jul 10 13:51:36.481574 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.481554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qkdpl" event={"ID":"6672fb14-fb97-4899-b368-e55e1a7b6c20","Type":"ContainerStarted","Data":"6e4da66907252f79c84484bbfc498300d9c0c2bcb0ca8e0a2f1f96af9d997853"}
Jul 10 13:51:36.523300 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.523157    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jdfjw" podStartSLOduration=34.533777943 podStartE2EDuration="37.523137161s" totalImagesPullingTime="2.989359218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:36.502789988 +0000 UTC m=+71.886988908" watchObservedRunningTime="2026-07-10 13:51:36.523137161 +0000 UTC m=+71.907336079"
Jul 10 13:51:36.523617 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:36.523585    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qkdpl" podStartSLOduration=66.3040065 podStartE2EDuration="1m10.523576117s" totalImagesPullingTime="4.219569617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:36.522802508 +0000 UTC m=+71.907001427" watchObservedRunningTime="2026-07-10 13:51:36.523576117 +0000 UTC m=+71.907775036"
Jul 10 13:51:38.489988 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.489960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p" event={"ID":"8c89891b-536a-48af-b2b2-6aac4aad0ddd","Type":"ContainerStarted","Data":"2c764ed1924eeea340ab4245cef6fb4b2d89486872d80c058b552660c556379a"}
Jul 10 13:51:38.775739 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.775649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:38.777995 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.777974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6cacac01-3507-4409-8daf-e2bee302c657-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-65c5g\" (UID: \"6cacac01-3507-4409-8daf-e2bee302c657\") " pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:38.981525 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.981488    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"]
Jul 10 13:51:38.983687 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.983667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:38.987836 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.987803    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 13:51:38.987962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.987803    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 13:51:38.987962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.987807    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 13:51:38.988384 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:38.988369    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 13:51:39.001458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.001431    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"]
Jul 10 13:51:39.017105 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.017074    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"]
Jul 10 13:51:39.040364 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.040277    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xrxqc\""
Jul 10 13:51:39.048531 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.048507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-65c5g"
Jul 10 13:51:39.052115 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.052092    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-655c5fbdf5-vcvz8"]
Jul 10 13:51:39.054184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.054166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.077448 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.077395    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655c5fbdf5-vcvz8"]
Jul 10 13:51:39.077697 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.077676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55ab6480-6696-42c4-95f5-0380c87023d9-klusterlet-config\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.077747 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.077715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55ab6480-6696-42c4-95f5-0380c87023d9-tmp\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.077786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.077776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j9v8\" (UniqueName: \"kubernetes.io/projected/55ab6480-6696-42c4-95f5-0380c87023d9-kube-api-access-6j9v8\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.179122 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-image-registry-private-configuration\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179274 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p24qc\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-kube-api-access-p24qc\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179274 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-trusted-ca\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179274 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-registry-tls\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179274 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55ab6480-6696-42c4-95f5-0380c87023d9-klusterlet-config\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.179458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-bound-sa-token\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55ab6480-6696-42c4-95f5-0380c87023d9-tmp\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.179458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j9v8\" (UniqueName: \"kubernetes.io/projected/55ab6480-6696-42c4-95f5-0380c87023d9-kube-api-access-6j9v8\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.179458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-registry-certificates\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-ca-trust-extracted\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-installation-pull-secrets\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.179815 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.179792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55ab6480-6696-42c4-95f5-0380c87023d9-tmp\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.181621 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.181602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/55ab6480-6696-42c4-95f5-0380c87023d9-klusterlet-config\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.188869 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.188842    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-65c5g"]
Jul 10 13:51:39.191591 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:39.191563    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cacac01_3507_4409_8daf_e2bee302c657.slice/crio-65cd2373369f0c1068c1b2bdf6ba0187ea89896104228b9b180c660522fe4f97 WatchSource:0}: Error finding container 65cd2373369f0c1068c1b2bdf6ba0187ea89896104228b9b180c660522fe4f97: Status 404 returned error can't find the container with id 65cd2373369f0c1068c1b2bdf6ba0187ea89896104228b9b180c660522fe4f97
Jul 10 13:51:39.198372 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.198349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j9v8\" (UniqueName: \"kubernetes.io/projected/55ab6480-6696-42c4-95f5-0380c87023d9-kube-api-access-6j9v8\") pod \"klusterlet-addon-workmgr-665fb674fb-xz6dd\" (UID: \"55ab6480-6696-42c4-95f5-0380c87023d9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.280735 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-registry-tls\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280735 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-bound-sa-token\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-registry-certificates\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-ca-trust-extracted\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-installation-pull-secrets\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-image-registry-private-configuration\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280897    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p24qc\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-kube-api-access-p24qc\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.280944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.280920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-trusted-ca\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.281320 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.281294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-ca-trust-extracted\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.281809 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.281781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-registry-certificates\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.281923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.281901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-trusted-ca\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.283277 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.283248    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-image-registry-private-configuration\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.283430 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.283397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-installation-pull-secrets\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.283495 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.283482    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-registry-tls\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.289966 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.289944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-bound-sa-token\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.290146 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.290130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p24qc\" (UniqueName: \"kubernetes.io/projected/2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1-kube-api-access-p24qc\") pod \"image-registry-655c5fbdf5-vcvz8\" (UID: \"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1\") " pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.293982 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.293943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:39.374396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.374371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:39.429627 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.429592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"]
Jul 10 13:51:39.433969 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:39.433890    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ab6480_6696_42c4_95f5_0380c87023d9.slice/crio-e218608225a1c6c853a5f8c08413002f7a8d0d634267b675788075b712428686 WatchSource:0}: Error finding container e218608225a1c6c853a5f8c08413002f7a8d0d634267b675788075b712428686: Status 404 returned error can't find the container with id e218608225a1c6c853a5f8c08413002f7a8d0d634267b675788075b712428686
Jul 10 13:51:39.496471 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.496434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p" event={"ID":"8c89891b-536a-48af-b2b2-6aac4aad0ddd","Type":"ContainerStarted","Data":"646335a86433a3efa149c1b6a6a6fea5784d5c8bf709cc95b46d5fca16d4f565"}
Jul 10 13:51:39.497576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.497554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd" event={"ID":"55ab6480-6696-42c4-95f5-0380c87023d9","Type":"ContainerStarted","Data":"e218608225a1c6c853a5f8c08413002f7a8d0d634267b675788075b712428686"}
Jul 10 13:51:39.498651 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.498624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-65c5g" event={"ID":"6cacac01-3507-4409-8daf-e2bee302c657","Type":"ContainerStarted","Data":"65cd2373369f0c1068c1b2bdf6ba0187ea89896104228b9b180c660522fe4f97"}
Jul 10 13:51:39.510283 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.510259    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655c5fbdf5-vcvz8"]
Jul 10 13:51:39.515221 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:39.515197    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba773c6_2fb5_4fbb_9cca_fe4cbc5f03c1.slice/crio-8bb92edfead6d5fd93f18245118fd1611b31ea1938c006bf259e86240ee83ba8 WatchSource:0}: Error finding container 8bb92edfead6d5fd93f18245118fd1611b31ea1938c006bf259e86240ee83ba8: Status 404 returned error can't find the container with id 8bb92edfead6d5fd93f18245118fd1611b31ea1938c006bf259e86240ee83ba8
Jul 10 13:51:39.516115 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:39.516066    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lr59p" podStartSLOduration=33.469653151 podStartE2EDuration="35.516027924s" totalImagesPullingTime="2.046374773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:39.515352548 +0000 UTC m=+74.899551467" watchObservedRunningTime="2026-07-10 13:51:39.516027924 +0000 UTC m=+74.900226844"
Jul 10 13:51:40.508525 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:40.508397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8" event={"ID":"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1","Type":"ContainerStarted","Data":"5bf6dd9ac570805359fa1dd4739397d28949a2beee2107d28d624ac337cd68c8"}
Jul 10 13:51:40.508525 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:40.508450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8" event={"ID":"2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1","Type":"ContainerStarted","Data":"8bb92edfead6d5fd93f18245118fd1611b31ea1938c006bf259e86240ee83ba8"}
Jul 10 13:51:40.508525 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:40.508494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:51:40.537823 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:40.536731    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8" podStartSLOduration=1.536706372 podStartE2EDuration="1.536706372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:40.536698225 +0000 UTC m=+75.920897145" watchObservedRunningTime="2026-07-10 13:51:40.536706372 +0000 UTC m=+75.920905292"
Jul 10 13:51:45.527603 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:45.527506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd" event={"ID":"55ab6480-6696-42c4-95f5-0380c87023d9","Type":"ContainerStarted","Data":"30b03140b9e5413f08f8412bc052c6b8cdda65632fb846fe60b7d191e63f2387"}
Jul 10 13:51:45.528029 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:45.527698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:45.529041 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:45.529013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-65c5g" event={"ID":"6cacac01-3507-4409-8daf-e2bee302c657","Type":"ContainerStarted","Data":"5d45cb8313057e0d2b540a377cb28e5f062700ca0e05a965c6acce131fd75d7a"}
Jul 10 13:51:45.529332 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:45.529316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd"
Jul 10 13:51:45.547311 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:45.547261    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-665fb674fb-xz6dd" podStartSLOduration=1.8322557160000001 podStartE2EDuration="7.547244092s" totalImagesPullingTime="5.714988376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:45.546519943 +0000 UTC m=+80.930718863" watchObservedRunningTime="2026-07-10 13:51:45.547244092 +0000 UTC m=+80.931443011"
Jul 10 13:51:46.487779 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:46.487748    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jdfjw"
Jul 10 13:51:46.535598 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:46.535554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-65c5g" event={"ID":"6cacac01-3507-4409-8daf-e2bee302c657","Type":"ContainerStarted","Data":"09e852a02cc335d838b90e70d8f528cb951ffc66a67b21525121072f6c9c0567"}
Jul 10 13:51:48.544476 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:48.544440    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-65c5g" event={"ID":"6cacac01-3507-4409-8daf-e2bee302c657","Type":"ContainerStarted","Data":"e2cbf1255454a54888094dd0c6b992200c99cc8273cdebfb42cd9d6445c21498"}
Jul 10 13:51:49.022882 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:49.022845    2561 patch_prober.go:28] interesting pod/image-registry-6f5b7fd4b5-kjg9p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 13:51:49.023185 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:49.022906    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" podUID="aa5d00cb-447a-4fce-9340-da11823814c8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 13:51:51.533842 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.533788    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-65c5g" podStartSLOduration=36.51590976 podStartE2EDuration="45.533769411s" totalImagesPullingTime="9.017859651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:51:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:48.569347793 +0000 UTC m=+83.953546732" watchObservedRunningTime="2026-07-10 13:51:51.533769411 +0000 UTC m=+86.917968330"
Jul 10 13:51:51.534602 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.534584    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"]
Jul 10 13:51:51.537356 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.537342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.540938 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.540902    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 13:51:51.541641 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.541621    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9n8nl\""
Jul 10 13:51:51.541709 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.541649    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 13:51:51.546991 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.546970    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 13:51:51.547793 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.547773    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 13:51:51.548094 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.548077    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 13:51:51.568120 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.568082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"]
Jul 10 13:51:51.598971 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.598932    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v6nrk"]
Jul 10 13:51:51.601093 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.601071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.605995 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.605956    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 13:51:51.606341 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.606324    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 13:51:51.606805 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.606790    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 13:51:51.607567 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.607547    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zk5vq\""
Jul 10 13:51:51.691277 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-sys\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691277 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-root\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691502 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-textfile\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691502 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac72f76-6d93-4603-9c21-0c9de1150295-metrics-client-ca\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691502 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e790df6-80c7-422a-9eb9-343e970cdb1b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.691502 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-tls\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691522    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e790df6-80c7-422a-9eb9-343e970cdb1b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.691649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-wtmp\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5tb6\" (UniqueName: \"kubernetes.io/projected/4e790df6-80c7-422a-9eb9-343e970cdb1b-kube-api-access-q5tb6\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.691825 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62wbj\" (UniqueName: \"kubernetes.io/projected/cac72f76-6d93-4603-9c21-0c9de1150295-kube-api-access-62wbj\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.691825 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e790df6-80c7-422a-9eb9-343e970cdb1b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.691825 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.691690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-textfile\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac72f76-6d93-4603-9c21-0c9de1150295-metrics-client-ca\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e790df6-80c7-422a-9eb9-343e970cdb1b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.792201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-tls\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e790df6-80c7-422a-9eb9-343e970cdb1b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-wtmp\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5tb6\" (UniqueName: \"kubernetes.io/projected/4e790df6-80c7-422a-9eb9-343e970cdb1b-kube-api-access-q5tb6\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62wbj\" (UniqueName: \"kubernetes.io/projected/cac72f76-6d93-4603-9c21-0c9de1150295-kube-api-access-62wbj\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e790df6-80c7-422a-9eb9-343e970cdb1b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792369    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-sys\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-wtmp\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792512 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-root\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792958 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-textfile\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792958 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-sys\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792958 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac72f76-6d93-4603-9c21-0c9de1150295-metrics-client-ca\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.792958 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.793174 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.792961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cac72f76-6d93-4603-9c21-0c9de1150295-root\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.793430 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.793411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e790df6-80c7-422a-9eb9-343e970cdb1b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.794867 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.794840    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.794996 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.794980    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cac72f76-6d93-4603-9c21-0c9de1150295-node-exporter-tls\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.795193 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.795175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e790df6-80c7-422a-9eb9-343e970cdb1b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.795256 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.795191    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e790df6-80c7-422a-9eb9-343e970cdb1b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.801395 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.801371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5tb6\" (UniqueName: \"kubernetes.io/projected/4e790df6-80c7-422a-9eb9-343e970cdb1b-kube-api-access-q5tb6\") pod \"openshift-state-metrics-84bd68b896-9p84s\" (UID: \"4e790df6-80c7-422a-9eb9-343e970cdb1b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.807789 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.807766    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62wbj\" (UniqueName: \"kubernetes.io/projected/cac72f76-6d93-4603-9c21-0c9de1150295-kube-api-access-62wbj\") pod \"node-exporter-v6nrk\" (UID: \"cac72f76-6d93-4603-9c21-0c9de1150295\") " pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.846020 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.845988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"
Jul 10 13:51:51.910382 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.910338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v6nrk"
Jul 10 13:51:51.921080 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:51.921040    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac72f76_6d93_4603_9c21_0c9de1150295.slice/crio-daf25d913425835633a880f6e5f933196519d9ed98968e3651ef92f845b81f58 WatchSource:0}: Error finding container daf25d913425835633a880f6e5f933196519d9ed98968e3651ef92f845b81f58: Status 404 returned error can't find the container with id daf25d913425835633a880f6e5f933196519d9ed98968e3651ef92f845b81f58
Jul 10 13:51:51.979007 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:51.978975    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s"]
Jul 10 13:51:51.981870 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:51.981844    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e790df6_80c7_422a_9eb9_343e970cdb1b.slice/crio-82e3541029650c6ba42c5095a5f5458ebe3bb3ecad0f13931ecf6564bec77b9a WatchSource:0}: Error finding container 82e3541029650c6ba42c5095a5f5458ebe3bb3ecad0f13931ecf6564bec77b9a: Status 404 returned error can't find the container with id 82e3541029650c6ba42c5095a5f5458ebe3bb3ecad0f13931ecf6564bec77b9a
Jul 10 13:51:52.560577 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.560542    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6nrk" event={"ID":"cac72f76-6d93-4603-9c21-0c9de1150295","Type":"ContainerStarted","Data":"daf25d913425835633a880f6e5f933196519d9ed98968e3651ef92f845b81f58"}
Jul 10 13:51:52.562361 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.562328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s" event={"ID":"4e790df6-80c7-422a-9eb9-343e970cdb1b","Type":"ContainerStarted","Data":"c0fad2e93a8bf48522c3dfc7e45b03bccb627ed995ccad678df818fbd464a8b0"}
Jul 10 13:51:52.562485 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.562380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s" event={"ID":"4e790df6-80c7-422a-9eb9-343e970cdb1b","Type":"ContainerStarted","Data":"0be10ec4afda6cd46efbfc3c8bb8dcc9cde0368b733c0d64aa03afd2ec896276"}
Jul 10 13:51:52.562485 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.562399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s" event={"ID":"4e790df6-80c7-422a-9eb9-343e970cdb1b","Type":"ContainerStarted","Data":"82e3541029650c6ba42c5095a5f5458ebe3bb3ecad0f13931ecf6564bec77b9a"}
Jul 10 13:51:52.575460 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.575432    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:51:52.578271 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.578255    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.581632 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.581607    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 13:51:52.581795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.581632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 13:51:52.581795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.581613    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 13:51:52.581795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.581613    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 13:51:52.581795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.581754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 13:51:52.582358 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.582331    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 13:51:52.582539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.582365    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 13:51:52.582539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.582371    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 13:51:52.582670 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.582558    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 13:51:52.582670 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.582563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5d2qf\""
Jul 10 13:51:52.595236 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.595206    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:51:52.699443 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699405    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.699632 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.699632 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.699756 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699675    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.699811 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.699811 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-config-volume\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-web-config\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.699977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-config-out\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.700015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqvg\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-kube-api-access-5dqvg\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.700316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.700100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.800912 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.800884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-config-out\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801003 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.800928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqvg\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-kube-api-access-5dqvg\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801003 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.800963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801003 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801151 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801208 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801259 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801318 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801318 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801302    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801412 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801412 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801412 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801552 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-config-volume\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.801552 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.801443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-web-config\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.802745 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.802716    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.803081 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.803023    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.803780 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.803733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-config-out\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.804589 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.804534    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.805192 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.805166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-web-config\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.806126 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.806081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-config-volume\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.806413 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.806362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.806713 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.806692    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.806944 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.806923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.807142 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.807114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.807220 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.807145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.812322 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.812302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqvg\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-kube-api-access-5dqvg\") pod \"alertmanager-main-0\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:52.888612 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:52.888583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:51:53.052499 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:53.052468    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:51:53.055365 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:53.055330    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4199db2_1edd_4377_88ae_f08d2a047758.slice/crio-94cab8a2953c5aa4e7ed1f325b11fa2ccb5f080fc98b0282b807f5fc13bf27e3 WatchSource:0}: Error finding container 94cab8a2953c5aa4e7ed1f325b11fa2ccb5f080fc98b0282b807f5fc13bf27e3: Status 404 returned error can't find the container with id 94cab8a2953c5aa4e7ed1f325b11fa2ccb5f080fc98b0282b807f5fc13bf27e3
Jul 10 13:51:53.567305 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:53.567222    2561 generic.go:356] "Generic (PLEG): container finished" podID="cac72f76-6d93-4603-9c21-0c9de1150295" containerID="7bb2e3f5864d74b1d10f5683d3052b226b9db267825ba69cbc943a983f69d046" exitCode=0
Jul 10 13:51:53.567702 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:53.567304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6nrk" event={"ID":"cac72f76-6d93-4603-9c21-0c9de1150295","Type":"ContainerDied","Data":"7bb2e3f5864d74b1d10f5683d3052b226b9db267825ba69cbc943a983f69d046"}
Jul 10 13:51:53.569597 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:53.569565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s" event={"ID":"4e790df6-80c7-422a-9eb9-343e970cdb1b","Type":"ContainerStarted","Data":"d1b19937340b165948506c9ff6376f38170bdda771a4b83a5fa2515f64b7e21f"}
Jul 10 13:51:53.570830 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:53.570801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"94cab8a2953c5aa4e7ed1f325b11fa2ccb5f080fc98b0282b807f5fc13bf27e3"}
Jul 10 13:51:53.612532 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:53.612490    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-9p84s" podStartSLOduration=1.37950445 podStartE2EDuration="2.612474054s" totalImagesPullingTime="1.232969604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:53.611131031 +0000 UTC m=+88.995329952" watchObservedRunningTime="2026-07-10 13:51:53.612474054 +0000 UTC m=+88.996672973"
Jul 10 13:51:54.577214 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:54.577170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6nrk" event={"ID":"cac72f76-6d93-4603-9c21-0c9de1150295","Type":"ContainerStarted","Data":"058a333bfbee6f83f41fc6bca69133b6f1ae5638b36bc11e105aee29c3fc41f3"}
Jul 10 13:51:54.577631 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:54.577237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6nrk" event={"ID":"cac72f76-6d93-4603-9c21-0c9de1150295","Type":"ContainerStarted","Data":"ad763d9b55b6db42ae86cf3be1004fac1190b69b3fe52fc300eb5fbecd03f393"}
Jul 10 13:51:54.578636 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:54.578604    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752" exitCode=0
Jul 10 13:51:54.578757 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:54.578693    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"}
Jul 10 13:51:54.613378 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:54.613320    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v6nrk" podStartSLOduration=2.660838076 podStartE2EDuration="3.613301793s" totalImagesPullingTime="869.018656ms" totalInitContainerRuntime="83.445061ms" isStatefulPod=true podCreationTimestamp="2026-07-10 13:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:54.611270179 +0000 UTC m=+89.995469122" watchObservedRunningTime="2026-07-10 13:51:54.613301793 +0000 UTC m=+89.997500712"
Jul 10 13:51:56.588927 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.588841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"}
Jul 10 13:51:56.589284 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.588936    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"}
Jul 10 13:51:56.589284 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.588962    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"}
Jul 10 13:51:56.589284 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.588987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"}
Jul 10 13:51:56.589284 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.589009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"}
Jul 10 13:51:56.722998 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.722961    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"]
Jul 10 13:51:56.726250 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.726233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.731378 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.731350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 13:51:56.731527 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.731397    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 13:51:56.731527 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.731418    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 13:51:56.731527 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.731397    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 13:51:56.731748 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.731735    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jpdbf\""
Jul 10 13:51:56.731920 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.731907    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 13:51:56.740105 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.740084    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 13:51:56.745712 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.745689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"]
Jul 10 13:51:56.836181 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-metrics-client-ca\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmlt\" (UniqueName: \"kubernetes.io/projected/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-kube-api-access-vzmlt\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836290    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-secret-telemeter-client\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-serving-certs-ca-bundle\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-telemeter-client-tls\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836505 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.836505 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.836391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-federate-client-tls\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.937755 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-secret-telemeter-client\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.937755 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-serving-certs-ca-bundle\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.937755 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937727    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-telemeter-client-tls\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.937755 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938101 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937792    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-federate-client-tls\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938101 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-metrics-client-ca\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938101 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmlt\" (UniqueName: \"kubernetes.io/projected/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-kube-api-access-vzmlt\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938101 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.937943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938617 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.938591    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-serving-certs-ca-bundle\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938822 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.938771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-metrics-client-ca\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.938941 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.938915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.940682 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.940660    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-telemeter-client-tls\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.940788 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.940758    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-secret-telemeter-client\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.940961 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.940928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-federate-client-tls\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.941129 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.941105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:56.947336 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:56.947312    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmlt\" (UniqueName: \"kubernetes.io/projected/a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd-kube-api-access-vzmlt\") pod \"telemeter-client-85cccbfd49-m6bm8\" (UID: \"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd\") " pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:57.034974 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.034934    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"
Jul 10 13:51:57.264088 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.263981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85cccbfd49-m6bm8"]
Jul 10 13:51:57.267382 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:57.267339    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e5a8c0_b9b2_44f1_9d67_32ebccbb92bd.slice/crio-350f2db2da875b2460fcbc57f508d3135b0e6d4a426b0bf7ebe3f3eb0ff7ada3 WatchSource:0}: Error finding container 350f2db2da875b2460fcbc57f508d3135b0e6d4a426b0bf7ebe3f3eb0ff7ada3: Status 404 returned error can't find the container with id 350f2db2da875b2460fcbc57f508d3135b0e6d4a426b0bf7ebe3f3eb0ff7ada3
Jul 10 13:51:57.595932 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.595895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerStarted","Data":"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"}
Jul 10 13:51:57.597103 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.597077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8" event={"ID":"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd","Type":"ContainerStarted","Data":"350f2db2da875b2460fcbc57f508d3135b0e6d4a426b0bf7ebe3f3eb0ff7ada3"}
Jul 10 13:51:57.629813 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.629718    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.099175487 podStartE2EDuration="5.629693866s" totalImagesPullingTime="3.515551585s" totalInitContainerRuntime="14.966794ms" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:51:57.626278715 +0000 UTC m=+93.010477658" watchObservedRunningTime="2026-07-10 13:51:57.629693866 +0000 UTC m=+93.013892786"
Jul 10 13:51:57.866553 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.866472    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:51:57.870610 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.870588    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:57.873603 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.873576    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 13:51:57.873951 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.873936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 13:51:57.874086 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.874068    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 13:51:57.874895 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.874875    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 13:51:57.874998 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.874931    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 13:51:57.875083 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875009    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 13:51:57.875137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875090    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9snls2q28l1gq\""
Jul 10 13:51:57.875137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875114    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 13:51:57.875612 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 13:51:57.875612 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875590    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 13:51:57.875875 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875846    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 13:51:57.875972 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.875935    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 13:51:57.876098 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.876079    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 13:51:57.876328 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.876312    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 13:51:57.876431 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.876344    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 13:51:57.876915 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.876894    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbptv\""
Jul 10 13:51:57.877347 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.877333    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 13:51:57.896567 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:57.896533    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:51:58.047291 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047291 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047758 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4g2l\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-kube-api-access-m4g2l\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047987 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047987 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047987 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047987 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047896    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.047987 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.047916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149061 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.148955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149061 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.148999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149061 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149113    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149330 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4g2l\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-kube-api-access-m4g2l\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.149706 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.149601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.150159 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.150014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.150159 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.150014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.152326 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.151979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.152715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.152906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.152970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.152975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.153216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.153530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.153649 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.153572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.154185 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.154160    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.154841 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.154798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.154841 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.154810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.155241 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.155200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.155435 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.155397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.155689 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.155670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.155889 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.155866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.156785 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.156757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.156975 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.156952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.162576 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.162551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4g2l\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-kube-api-access-m4g2l\") pod \"prometheus-k8s-0\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.181470 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.181437    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:51:58.346174 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.346033    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:51:58.348468 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:51:58.348436    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcc48d0_2508_436d_999f_4b620b5a1c9b.slice/crio-e97429ed70f5e87a4342a7eef518b8ae37f4af92fec4997ba8c8c2295257dd10 WatchSource:0}: Error finding container e97429ed70f5e87a4342a7eef518b8ae37f4af92fec4997ba8c8c2295257dd10: Status 404 returned error can't find the container with id e97429ed70f5e87a4342a7eef518b8ae37f4af92fec4997ba8c8c2295257dd10
Jul 10 13:51:58.602555 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.602524    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88" exitCode=0
Jul 10 13:51:58.602938 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.602614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"}
Jul 10 13:51:58.602938 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:58.602676    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"e97429ed70f5e87a4342a7eef518b8ae37f4af92fec4997ba8c8c2295257dd10"}
Jul 10 13:51:59.022672 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:51:59.022641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:52:00.614060 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:00.614008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8" event={"ID":"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd","Type":"ContainerStarted","Data":"9cc09bd6722f4d05646fad341fecc93eb6961b39e7479c646d4f786113b4f8c4"}
Jul 10 13:52:00.614500 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:00.614098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8" event={"ID":"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd","Type":"ContainerStarted","Data":"c5d30824143abbf9d78b16c83baf0fceb7d65a90f9672e1f71d13f47e9b64ada"}
Jul 10 13:52:00.614500 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:00.614132    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8" event={"ID":"a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd","Type":"ContainerStarted","Data":"cc2a1dcdd03003995677f9188dc7113e44fb0f588e0410e6aff887a1d7fa1181"}
Jul 10 13:52:00.638633 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:00.638568    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85cccbfd49-m6bm8" podStartSLOduration=2.266424163 podStartE2EDuration="4.638546325s" totalImagesPullingTime="2.372122162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:00.637582706 +0000 UTC m=+96.021781626" watchObservedRunningTime="2026-07-10 13:52:00.638546325 +0000 UTC m=+96.022745242"
Jul 10 13:52:02.519201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:02.519171    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-655c5fbdf5-vcvz8"
Jul 10 13:52:02.625911 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:02.625873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"}
Jul 10 13:52:02.626083 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:02.625960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"}
Jul 10 13:52:03.461959 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:03.461926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pjvbd"
Jul 10 13:52:04.037109 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.036987    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" podUID="aa5d00cb-447a-4fce-9340-da11823814c8" containerName="registry" containerID="cri-o://30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b" gracePeriod=30
Jul 10 13:52:04.311682 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.311626    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:52:04.314624 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314602    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa5d00cb-447a-4fce-9340-da11823814c8-ca-trust-extracted\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314726 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314674    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-bound-sa-token\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314781 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314743    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-registry-certificates\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314781 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-installation-pull-secrets\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314873 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314822    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-trusted-ca\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314873 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314848    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7rfm\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-kube-api-access-n7rfm\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314981 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314873    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.314981 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.314910    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-image-registry-private-configuration\") pod \"aa5d00cb-447a-4fce-9340-da11823814c8\" (UID: \"aa5d00cb-447a-4fce-9340-da11823814c8\") "
Jul 10 13:52:04.315556 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.315461    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:04.315727 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.315705    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:52:04.318308 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.318264    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-kube-api-access-n7rfm" (OuterVolumeSpecName: "kube-api-access-n7rfm") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "kube-api-access-n7rfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:04.318768 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.318712    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:52:04.319235 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.319168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:04.319328 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.319262    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:52:04.321439 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.321406    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:52:04.325260 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.325211    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5d00cb-447a-4fce-9340-da11823814c8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa5d00cb-447a-4fce-9340-da11823814c8" (UID: "aa5d00cb-447a-4fce-9340-da11823814c8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:52:04.416136 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416100    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-bound-sa-token\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416136 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416130    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-registry-certificates\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416136 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416140    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-installation-pull-secrets\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416136 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416149    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa5d00cb-447a-4fce-9340-da11823814c8-trusted-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416394 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416160    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7rfm\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-kube-api-access-n7rfm\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416394 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416168    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa5d00cb-447a-4fce-9340-da11823814c8-registry-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416394 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416176    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa5d00cb-447a-4fce-9340-da11823814c8-image-registry-private-configuration\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.416394 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.416186    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa5d00cb-447a-4fce-9340-da11823814c8-ca-trust-extracted\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:52:04.637427 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.637388    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"}
Jul 10 13:52:04.637619 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.637471    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"}
Jul 10 13:52:04.637619 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.637523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"}
Jul 10 13:52:04.637619 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.637562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerStarted","Data":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"}
Jul 10 13:52:04.638710 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.638685    2561 generic.go:356] "Generic (PLEG): container finished" podID="aa5d00cb-447a-4fce-9340-da11823814c8" containerID="30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b" exitCode=0
Jul 10 13:52:04.638821 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.638715    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"
Jul 10 13:52:04.638821 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.638758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" event={"ID":"aa5d00cb-447a-4fce-9340-da11823814c8","Type":"ContainerDied","Data":"30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b"}
Jul 10 13:52:04.638821 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.638792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p" event={"ID":"aa5d00cb-447a-4fce-9340-da11823814c8","Type":"ContainerDied","Data":"3d15f317d7ba774c159d7da7f64dd9b121b4936159aca7acea1eb1501cb725a4"}
Jul 10 13:52:04.638926 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.638826    2561 scope.go:117] "RemoveContainer" containerID="30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b"
Jul 10 13:52:04.651865 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.651841    2561 scope.go:117] "RemoveContainer" containerID="30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b"
Jul 10 13:52:04.652248 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:52:04.652225    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b\": container with ID starting with 30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b not found: ID does not exist" containerID="30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b"
Jul 10 13:52:04.652341 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.652254    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b"} err="failed to get container status \"30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b\": rpc error: code = NotFound desc = could not find container \"30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b\": container with ID starting with 30f0d02a88e6d8e37de13be1f51f61b1e4713f350c13067f537502754fc7324b not found: ID does not exist"
Jul 10 13:52:04.672369 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.672316    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.395905705 podStartE2EDuration="7.672299705s" totalImagesPullingTime="5.257591203s" totalInitContainerRuntime="18.802797ms" isStatefulPod=false podCreationTimestamp="2026-07-10 13:51:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:04.6701774 +0000 UTC m=+100.054376321" watchObservedRunningTime="2026-07-10 13:52:04.672299705 +0000 UTC m=+100.056498624"
Jul 10 13:52:04.684329 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.684297    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"]
Jul 10 13:52:04.688044 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:04.688019    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f5b7fd4b5-kjg9p"]
Jul 10 13:52:05.142361 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:05.142317    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5d00cb-447a-4fce-9340-da11823814c8" path="/var/lib/kubelet/pods/aa5d00cb-447a-4fce-9340-da11823814c8/volumes"
Jul 10 13:52:08.181585 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:08.181547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:52:25.722467 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:25.722431    2561 generic.go:356] "Generic (PLEG): container finished" podID="68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c" containerID="c2191cf61ddd54e360f90e2908cf3446a5d014bf43e2992817e6a69e36d76ac1" exitCode=0
Jul 10 13:52:25.722886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:25.722488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48" event={"ID":"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c","Type":"ContainerDied","Data":"c2191cf61ddd54e360f90e2908cf3446a5d014bf43e2992817e6a69e36d76ac1"}
Jul 10 13:52:25.722886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:25.722800    2561 scope.go:117] "RemoveContainer" containerID="c2191cf61ddd54e360f90e2908cf3446a5d014bf43e2992817e6a69e36d76ac1"
Jul 10 13:52:26.728012 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:26.727976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-ccf48" event={"ID":"68c7e6a3-39e3-4a1d-8977-4b1e9bb07f9c","Type":"ContainerStarted","Data":"601a30ecac3bf6c2b2b971c68365e92e469b15fa64447d79ffdf8fa837de4211"}
Jul 10 13:52:36.768612 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:36.768518    2561 generic.go:356] "Generic (PLEG): container finished" podID="8d7c57ff-c508-40ae-8b14-9e46b6f55ea3" containerID="ef0b211bff1efde4a4b03c4e7ea6307e8b9bf5a8b1addf6f090d20f1fb3fbb64" exitCode=0
Jul 10 13:52:36.768612 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:36.768567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9" event={"ID":"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3","Type":"ContainerDied","Data":"ef0b211bff1efde4a4b03c4e7ea6307e8b9bf5a8b1addf6f090d20f1fb3fbb64"}
Jul 10 13:52:36.769194 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:36.769032    2561 scope.go:117] "RemoveContainer" containerID="ef0b211bff1efde4a4b03c4e7ea6307e8b9bf5a8b1addf6f090d20f1fb3fbb64"
Jul 10 13:52:37.774096 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:37.774043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rjgq9" event={"ID":"8d7c57ff-c508-40ae-8b14-9e46b6f55ea3","Type":"ContainerStarted","Data":"6db4cfb52ac30ad46563395d8d9e4077a48775e8c871c90e878f379ea4e01841"}
Jul 10 13:52:58.182527 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:58.182484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:52:58.202236 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:58.202211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:52:58.875910 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:52:58.875885    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:11.975184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975150    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:53:11.975682 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975425    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="alertmanager" containerID="cri-o://5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60" gracePeriod=120
Jul 10 13:53:11.975682 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975505    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-metric" containerID="cri-o://53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57" gracePeriod=120
Jul 10 13:53:11.975682 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975542    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-web" containerID="cri-o://59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27" gracePeriod=120
Jul 10 13:53:11.975854 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975656    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="prom-label-proxy" containerID="cri-o://bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080" gracePeriod=120
Jul 10 13:53:11.975854 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975683    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy" containerID="cri-o://56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c" gracePeriod=120
Jul 10 13:53:11.975854 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:11.975691    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="config-reloader" containerID="cri-o://c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7" gracePeriod=120
Jul 10 13:53:12.917886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.917849    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080" exitCode=0
Jul 10 13:53:12.917886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.917875    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c" exitCode=0
Jul 10 13:53:12.917886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.917882    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7" exitCode=0
Jul 10 13:53:12.917886 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.917889    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60" exitCode=0
Jul 10 13:53:12.918163 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.917911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"}
Jul 10 13:53:12.918163 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.917989    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"}
Jul 10 13:53:12.918163 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.918015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"}
Jul 10 13:53:12.918163 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:12.918038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"}
Jul 10 13:53:13.218617 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.218588    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:13.333275 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333247    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-config-volume\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333463 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333299    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-web\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333463 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333350    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-main-tls\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333463 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-main-db\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333463 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-metrics-client-ca\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333463 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-web-config\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333463 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333435    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dqvg\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-kube-api-access-5dqvg\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333526    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-tls-assets\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333556    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333595    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-trusted-ca-bundle\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333619    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-cluster-tls-config\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333643    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-config-out\") pod \"b4199db2-1edd-4377-88ae-f08d2a047758\" (UID: \"b4199db2-1edd-4377-88ae-f08d2a047758\") "
Jul 10 13:53:13.333786 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:53:13.334161 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333788    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:13.334161 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333964    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-main-db\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.334161 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.333983    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-metrics-client-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.334508 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.334477    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:13.336197 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.336146    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.336437 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.336411    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:53:13.336749 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.336725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-config-out" (OuterVolumeSpecName: "config-out") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:53:13.336906 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.336881    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.337406 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.337365    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-config-volume" (OuterVolumeSpecName: "config-volume") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.337509 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.337410    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-kube-api-access-5dqvg" (OuterVolumeSpecName: "kube-api-access-5dqvg") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "kube-api-access-5dqvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:53:13.337722 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.337693    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.338396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.338373    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.340791 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.340762    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.348958 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.348933    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-web-config" (OuterVolumeSpecName: "web-config") pod "b4199db2-1edd-4377-88ae-f08d2a047758" (UID: "b4199db2-1edd-4377-88ae-f08d2a047758"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:13.434577 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434533    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dqvg\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-kube-api-access-5dqvg\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434577 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434577    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434577 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434588    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b4199db2-1edd-4377-88ae-f08d2a047758-tls-assets\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434577 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434602    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434612    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4199db2-1edd-4377-88ae-f08d2a047758-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434620    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-cluster-tls-config\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434629    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b4199db2-1edd-4377-88ae-f08d2a047758-config-out\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434636    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-config-volume\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434644    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434653    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-secret-alertmanager-main-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.434839 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.434661    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b4199db2-1edd-4377-88ae-f08d2a047758-web-config\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:13.924888 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.924844    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57" exitCode=0
Jul 10 13:53:13.924888 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.924877    2561 generic.go:356] "Generic (PLEG): container finished" podID="b4199db2-1edd-4377-88ae-f08d2a047758" containerID="59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27" exitCode=0
Jul 10 13:53:13.925110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.924927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"}
Jul 10 13:53:13.925110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.924942    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:13.925110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.925004    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"}
Jul 10 13:53:13.925110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.925033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b4199db2-1edd-4377-88ae-f08d2a047758","Type":"ContainerDied","Data":"94cab8a2953c5aa4e7ed1f325b11fa2ccb5f080fc98b0282b807f5fc13bf27e3"}
Jul 10 13:53:13.925110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.925077    2561 scope.go:117] "RemoveContainer" containerID="bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"
Jul 10 13:53:13.934882 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.934781    2561 scope.go:117] "RemoveContainer" containerID="53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"
Jul 10 13:53:13.942459 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.942443    2561 scope.go:117] "RemoveContainer" containerID="56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"
Jul 10 13:53:13.949565 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.949529    2561 scope.go:117] "RemoveContainer" containerID="59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"
Jul 10 13:53:13.950833 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.950805    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:53:13.955006 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.954979    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:53:13.957791 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.957771    2561 scope.go:117] "RemoveContainer" containerID="c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"
Jul 10 13:53:13.964965 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.964945    2561 scope.go:117] "RemoveContainer" containerID="5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"
Jul 10 13:53:13.972150 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.972128    2561 scope.go:117] "RemoveContainer" containerID="79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"
Jul 10 13:53:13.979773 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.979753    2561 scope.go:117] "RemoveContainer" containerID="bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"
Jul 10 13:53:13.980094 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.980068    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080\": container with ID starting with bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080 not found: ID does not exist" containerID="bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"
Jul 10 13:53:13.980184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.980122    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"} err="failed to get container status \"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080\": rpc error: code = NotFound desc = could not find container \"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080\": container with ID starting with bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080 not found: ID does not exist"
Jul 10 13:53:13.980184 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.980152    2561 scope.go:117] "RemoveContainer" containerID="53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"
Jul 10 13:53:13.980716 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.980585    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57\": container with ID starting with 53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57 not found: ID does not exist" containerID="53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"
Jul 10 13:53:13.980716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.980617    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"} err="failed to get container status \"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57\": rpc error: code = NotFound desc = could not find container \"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57\": container with ID starting with 53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57 not found: ID does not exist"
Jul 10 13:53:13.980716 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.980639    2561 scope.go:117] "RemoveContainer" containerID="56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"
Jul 10 13:53:13.980985 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.980953    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c\": container with ID starting with 56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c not found: ID does not exist" containerID="56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"
Jul 10 13:53:13.980985 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.980985    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"} err="failed to get container status \"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c\": rpc error: code = NotFound desc = could not find container \"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c\": container with ID starting with 56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c not found: ID does not exist"
Jul 10 13:53:13.980985 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981007    2561 scope.go:117] "RemoveContainer" containerID="59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"
Jul 10 13:53:13.981415 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.981390    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27\": container with ID starting with 59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27 not found: ID does not exist" containerID="59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"
Jul 10 13:53:13.981528 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981414    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"} err="failed to get container status \"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27\": rpc error: code = NotFound desc = could not find container \"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27\": container with ID starting with 59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27 not found: ID does not exist"
Jul 10 13:53:13.981528 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981429    2561 scope.go:117] "RemoveContainer" containerID="c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"
Jul 10 13:53:13.981675 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.981651    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7\": container with ID starting with c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7 not found: ID does not exist" containerID="c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"
Jul 10 13:53:13.981734 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981681    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"} err="failed to get container status \"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7\": rpc error: code = NotFound desc = could not find container \"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7\": container with ID starting with c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7 not found: ID does not exist"
Jul 10 13:53:13.981734 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981701    2561 scope.go:117] "RemoveContainer" containerID="5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"
Jul 10 13:53:13.981939 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.981918    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60\": container with ID starting with 5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60 not found: ID does not exist" containerID="5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"
Jul 10 13:53:13.981995 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981944    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"} err="failed to get container status \"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60\": rpc error: code = NotFound desc = could not find container \"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60\": container with ID starting with 5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60 not found: ID does not exist"
Jul 10 13:53:13.981995 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.981956    2561 scope.go:117] "RemoveContainer" containerID="79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"
Jul 10 13:53:13.982200 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:13.982182    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752\": container with ID starting with 79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752 not found: ID does not exist" containerID="79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"
Jul 10 13:53:13.982261 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982207    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"} err="failed to get container status \"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752\": rpc error: code = NotFound desc = could not find container \"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752\": container with ID starting with 79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752 not found: ID does not exist"
Jul 10 13:53:13.982261 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982222    2561 scope.go:117] "RemoveContainer" containerID="bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"
Jul 10 13:53:13.982412 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982395    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080"} err="failed to get container status \"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080\": rpc error: code = NotFound desc = could not find container \"bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080\": container with ID starting with bcebddb9d02ac66c8a37969f640714f405e5362da8656d3e897ff952a6d8a080 not found: ID does not exist"
Jul 10 13:53:13.982474 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982414    2561 scope.go:117] "RemoveContainer" containerID="53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"
Jul 10 13:53:13.982594 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982577    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57"} err="failed to get container status \"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57\": rpc error: code = NotFound desc = could not find container \"53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57\": container with ID starting with 53b9ddf941a5b4f1e386a0a511dbfc9c26bbafb8aaa7259a3b4e73f262808b57 not found: ID does not exist"
Jul 10 13:53:13.982652 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982596    2561 scope.go:117] "RemoveContainer" containerID="56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"
Jul 10 13:53:13.982722 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982706    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:53:13.982847 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982829    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c"} err="failed to get container status \"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c\": rpc error: code = NotFound desc = could not find container \"56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c\": container with ID starting with 56106f59cd32bae3ee021ad29726e9a6d1043cb3ca73feb6dd624373aba6ad5c not found: ID does not exist"
Jul 10 13:53:13.982904 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.982848    2561 scope.go:117] "RemoveContainer" containerID="59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"
Jul 10 13:53:13.983071 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983038    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5d00cb-447a-4fce-9340-da11823814c8" containerName="registry"
Jul 10 13:53:13.983125 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983065    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27"} err="failed to get container status \"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27\": rpc error: code = NotFound desc = could not find container \"59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27\": container with ID starting with 59d285178d4406af02ef8d4dfc7290f13f75e7c135cc5bf604d9c54727fc6b27 not found: ID does not exist"
Jul 10 13:53:13.983125 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983086    2561 scope.go:117] "RemoveContainer" containerID="c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"
Jul 10 13:53:13.983125 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983070    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5d00cb-447a-4fce-9340-da11823814c8" containerName="registry"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983139    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="init-config-reloader"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983148    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="init-config-reloader"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983161    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983167    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983174    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="config-reloader"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983180    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="config-reloader"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983188    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-web"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983197    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-web"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983207    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-metric"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983217    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-metric"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983227    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="alertmanager"
Jul 10 13:53:13.983234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983235    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="alertmanager"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983248    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="prom-label-proxy"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983254    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="prom-label-proxy"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983313    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7"} err="failed to get container status \"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7\": rpc error: code = NotFound desc = could not find container \"c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7\": container with ID starting with c4b89ab8efab26b9a8bde4996004b411421c1386db926dd56a2b4be0b3ea85a7 not found: ID does not exist"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983337    2561 scope.go:117] "RemoveContainer" containerID="5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983341    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5d00cb-447a-4fce-9340-da11823814c8" containerName="registry"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983393    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983401    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="config-reloader"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983407    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-web"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983412    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="kube-rbac-proxy-metric"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983420    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="alertmanager"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983429    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" containerName="prom-label-proxy"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983591    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60"} err="failed to get container status \"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60\": rpc error: code = NotFound desc = could not find container \"5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60\": container with ID starting with 5c9062250100183f355c3544857f2741f4bf120c1cd226b9d453f9a7db79be60 not found: ID does not exist"
Jul 10 13:53:13.983615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983607    2561 scope.go:117] "RemoveContainer" containerID="79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"
Jul 10 13:53:13.984011 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.983818    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752"} err="failed to get container status \"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752\": rpc error: code = NotFound desc = could not find container \"79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752\": container with ID starting with 79c96f6b3ad59933324651fd8a314270f5660212290506f536962a656a59e752 not found: ID does not exist"
Jul 10 13:53:13.988533 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.988515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:13.990888 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.990869    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 13:53:13.991178 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991153    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 13:53:13.991421 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 13:53:13.991421 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991369    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5d2qf\""
Jul 10 13:53:13.991421 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991395    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 13:53:13.991619 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 13:53:13.991772 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991757    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 13:53:13.991848 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.991760    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 13:53:13.992118 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.992104    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 13:53:13.996950 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:13.996933    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 13:53:14.007621 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.007594    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:53:14.140618 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140618 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140712    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.140843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.141022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-config-out\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.141022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-web-config\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.141022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.141022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140937    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.141022 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.140964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnvl\" (UniqueName: \"kubernetes.io/projected/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-kube-api-access-jfnvl\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.241836 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.241836 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.241836 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnvl\" (UniqueName: \"kubernetes.io/projected/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-kube-api-access-jfnvl\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.241981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.242009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.242075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.242109    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.242152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-config-out\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.242411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.242186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-web-config\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.244315 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.243140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.244315 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.243743    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.244315 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.244029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.244883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.244982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.245294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.245339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-web-config\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245580 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.245397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245580 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.245429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.245580 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.245429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.246309 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.246287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-config-out\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.246840 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.246823    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.250137 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.250114    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnvl\" (UniqueName: \"kubernetes.io/projected/c8003511-b7f8-4e04-adf7-ea7ae6dc9c87-kube-api-access-jfnvl\") pod \"alertmanager-main-0\" (UID: \"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.299213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.299171    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 13:53:14.442781 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.442756    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 13:53:14.445333 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:53:14.445307    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8003511_b7f8_4e04_adf7_ea7ae6dc9c87.slice/crio-ef99c6261df244b97fa521d51a3560142b26ed1d9716b93dc3525f84d9831f03 WatchSource:0}: Error finding container ef99c6261df244b97fa521d51a3560142b26ed1d9716b93dc3525f84d9831f03: Status 404 returned error can't find the container with id ef99c6261df244b97fa521d51a3560142b26ed1d9716b93dc3525f84d9831f03
Jul 10 13:53:14.930819 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.930783    2561 generic.go:356] "Generic (PLEG): container finished" podID="c8003511-b7f8-4e04-adf7-ea7ae6dc9c87" containerID="e5836ff1b3a389f22a1091658e20dd37473420fa1d2cf98417bb3c1e52329147" exitCode=0
Jul 10 13:53:14.931018 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.930875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerDied","Data":"e5836ff1b3a389f22a1091658e20dd37473420fa1d2cf98417bb3c1e52329147"}
Jul 10 13:53:14.931018 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:14.930961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"ef99c6261df244b97fa521d51a3560142b26ed1d9716b93dc3525f84d9831f03"}
Jul 10 13:53:15.141848 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.141819    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4199db2-1edd-4377-88ae-f08d2a047758" path="/var/lib/kubelet/pods/b4199db2-1edd-4377-88ae-f08d2a047758/volumes"
Jul 10 13:53:15.942153 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.942117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"04f9edf786450222ff6e868d4c2f1f061e71c8407894649df8975e82c23da753"}
Jul 10 13:53:15.942539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.942190    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"be88021c08fb1428be93111bee35e35e033a5615c1e8d2cda375e28c03cb1aee"}
Jul 10 13:53:15.942539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.942222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"861a0d726a78770d32e8f97cdb6e9fc7cfe9e5b6850cd3750ef3e9c18fb8098b"}
Jul 10 13:53:15.942539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.942248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"ec4b495c8aa0c358112c891425897217e18be9048b89d61963ae6c5d34bd2653"}
Jul 10 13:53:15.942539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.942272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"eb8abe04c89569424c8e29492c2019c8898e481cb21158980722f3cd6a93bd87"}
Jul 10 13:53:15.942539 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.942295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8003511-b7f8-4e04-adf7-ea7ae6dc9c87","Type":"ContainerStarted","Data":"88d042284c8fe6d33af7d0205fd5cd4dc2542a630d82ef68db0671f0fa303e4c"}
Jul 10 13:53:15.978922 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:15.978822    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.959444588 podStartE2EDuration="2.978798086s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.353498ms" isStatefulPod=false podCreationTimestamp="2026-07-10 13:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:53:15.977279337 +0000 UTC m=+171.361478255" watchObservedRunningTime="2026-07-10 13:53:15.978798086 +0000 UTC m=+171.362997006"
Jul 10 13:53:16.214167 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214039    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:53:16.214424 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214392    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="prometheus" containerID="cri-o://84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2" gracePeriod=600
Jul 10 13:53:16.214524 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214448    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-web" containerID="cri-o://9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319" gracePeriod=600
Jul 10 13:53:16.214524 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214466    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="config-reloader" containerID="cri-o://15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45" gracePeriod=600
Jul 10 13:53:16.214608 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214416    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy" containerID="cri-o://eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3" gracePeriod=600
Jul 10 13:53:16.214608 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214446    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="thanos-sidecar" containerID="cri-o://896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003" gracePeriod=600
Jul 10 13:53:16.214701 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.214441    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1" gracePeriod=600
Jul 10 13:53:16.458094 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.458072    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:16.561780 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561749    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-tls\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.561929 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561789    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-metrics-client-certs\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.561929 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561817    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-db\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.561929 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config-out\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.561929 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561881    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-web-config\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.561929 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561910    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-thanos-prometheus-http-client-file\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561938    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-serving-certs-ca-bundle\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.561980    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-kubelet-serving-ca-bundle\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-grpc-tls\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562035    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562087    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4g2l\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-kube-api-access-m4g2l\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562120    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-2\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562154    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-kube-rbac-proxy\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-tls-assets\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562239    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-1\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562286    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562324    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-metrics-client-ca\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562349    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562378    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-trusted-ca-bundle\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.562401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-0\") pod \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\" (UID: \"2bcc48d0-2508-436d-999f-4b620b5a1c9b\") "
Jul 10 13:53:16.563124 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562718    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.563124 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.562984    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.563411 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.563383    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:53:16.563577 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.563412    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.563662 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.563634    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.563747 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.563680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.564118 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.564094    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.565289 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.565254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:53:16.565710 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.565669    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.565811 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.565749    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.566170 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566144    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.566267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566206    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config-out" (OuterVolumeSpecName: "config-out") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:53:16.566327 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566283    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.566450 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566418    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.566648 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.566950 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566931    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:53:16.567010 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.566973    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-kube-api-access-m4g2l" (OuterVolumeSpecName: "kube-api-access-m4g2l") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "kube-api-access-m4g2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:53:16.567450 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.567431    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config" (OuterVolumeSpecName: "config") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.567832 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.567810    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.576399 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.576375    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-web-config" (OuterVolumeSpecName: "web-config") pod "2bcc48d0-2508-436d-999f-4b620b5a1c9b" (UID: "2bcc48d0-2508-436d-999f-4b620b5a1c9b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:53:16.663931 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663885    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.663931 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663928    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-kube-rbac-proxy\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.663931 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663939    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-tls-assets\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.663931 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663951    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663961    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663970    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-metrics-client-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663979    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663988    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.663997    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664006    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664015    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-metrics-client-certs\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664023    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-prometheus-k8s-db\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664031    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bcc48d0-2508-436d-999f-4b620b5a1c9b-config-out\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664038    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-web-config\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664071    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664080    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664088    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bcc48d0-2508-436d-999f-4b620b5a1c9b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664098    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-grpc-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664106    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2bcc48d0-2508-436d-999f-4b620b5a1c9b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.664213 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.664115    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4g2l\" (UniqueName: \"kubernetes.io/projected/2bcc48d0-2508-436d-999f-4b620b5a1c9b-kube-api-access-m4g2l\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 13:53:16.949615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949535    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1" exitCode=0
Jul 10 13:53:16.949615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949561    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3" exitCode=0
Jul 10 13:53:16.949615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949567    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319" exitCode=0
Jul 10 13:53:16.949615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949575    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003" exitCode=0
Jul 10 13:53:16.949615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949581    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45" exitCode=0
Jul 10 13:53:16.949615 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949586    2561 generic.go:356] "Generic (PLEG): container finished" podID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2" exitCode=0
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"}
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949628    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"}
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"}
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949763    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"}
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949776    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"}
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"}
Jul 10 13:53:16.950254 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.949838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2bcc48d0-2508-436d-999f-4b620b5a1c9b","Type":"ContainerDied","Data":"e97429ed70f5e87a4342a7eef518b8ae37f4af92fec4997ba8c8c2295257dd10"}
Jul 10 13:53:16.958943 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.958819    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:16.966401 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.966386    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:16.974666 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.974635    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:16.975281 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.975256    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:53:16.979088 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.979065    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:53:16.982597 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.982579    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:16.989737 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.989717    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:16.997155 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:16.997133    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.005161 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.005114    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.005437 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.005418    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.005496 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.005446    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"} err="failed to get container status \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist"
Jul 10 13:53:17.005496 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.005466    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.005738 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.005721    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.005802 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.005749    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"} err="failed to get container status \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist"
Jul 10 13:53:17.005802 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.005772    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.006005 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.005989    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.006076 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006011    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"} err="failed to get container status \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist"
Jul 10 13:53:17.006076 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006030    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.006302 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.006280    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.006368 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006309    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"} err="failed to get container status \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist"
Jul 10 13:53:17.006368 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006327    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.006609 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.006590    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.006663 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006615    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"} err="failed to get container status \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist"
Jul 10 13:53:17.006663 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006632    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.006895 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.006869    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.006971 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006903    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"} err="failed to get container status \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist"
Jul 10 13:53:17.006971 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.006926    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.007193 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:53:17.007173    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.007275 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.007196    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"} err="failed to get container status \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist"
Jul 10 13:53:17.007275 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.007211    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.007499 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.007464    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"} err="failed to get container status \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist"
Jul 10 13:53:17.007499 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.007484    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.007795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.007773    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"} err="failed to get container status \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist"
Jul 10 13:53:17.007795 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.007796    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.008035 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008010    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"} err="failed to get container status \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist"
Jul 10 13:53:17.008122 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008039    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.008332 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008301    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"} err="failed to get container status \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist"
Jul 10 13:53:17.008332 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008323    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.008578 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008560    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"} err="failed to get container status \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist"
Jul 10 13:53:17.008578 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008578    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.008776 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008761    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"} err="failed to get container status \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist"
Jul 10 13:53:17.008776 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.008776    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.009138 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009089    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"} err="failed to get container status \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist"
Jul 10 13:53:17.009240 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009137    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.009466 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009444    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"} err="failed to get container status \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist"
Jul 10 13:53:17.009566 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009467    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.009731 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009711    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"} err="failed to get container status \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist"
Jul 10 13:53:17.009807 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009732    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.010018 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.009996    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"} err="failed to get container status \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist"
Jul 10 13:53:17.010089 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010021    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.010208 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010179    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:53:17.010345 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010327    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"} err="failed to get container status \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist"
Jul 10 13:53:17.010409 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010347    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.010524 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010510    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010525    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010534    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="init-config-reloader"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010541    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="init-config-reloader"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010549    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"} err="failed to get container status \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010564    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010556    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="config-reloader"
Jul 10 13:53:17.010607 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010607    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="config-reloader"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010622    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-thanos"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010628    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-thanos"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010642    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="thanos-sidecar"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010647    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="thanos-sidecar"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010655    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-web"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010662    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-web"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010672    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="prometheus"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010680    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="prometheus"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010754    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-thanos"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010766    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="thanos-sidecar"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010775    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="config-reloader"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010782    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="prometheus"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010789    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010795    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" containerName="kube-rbac-proxy-web"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010793    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"} err="failed to get container status \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist"
Jul 10 13:53:17.010851 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.010810    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.011390 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011069    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"} err="failed to get container status \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist"
Jul 10 13:53:17.011390 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011082    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.011390 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011274    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"} err="failed to get container status \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist"
Jul 10 13:53:17.011390 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011288    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.011511 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011477    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"} err="failed to get container status \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist"
Jul 10 13:53:17.011511 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011492    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.011739 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011719    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"} err="failed to get container status \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist"
Jul 10 13:53:17.011803 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011740    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.012002 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.011984    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"} err="failed to get container status \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist"
Jul 10 13:53:17.012071 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012002    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.012263 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012245    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"} err="failed to get container status \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist"
Jul 10 13:53:17.012338 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012265    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.012476 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012459    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"} err="failed to get container status \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist"
Jul 10 13:53:17.012531 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012476    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.012639 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012622    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"} err="failed to get container status \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist"
Jul 10 13:53:17.012697 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012641    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.012827 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012812    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"} err="failed to get container status \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist"
Jul 10 13:53:17.012870 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012830    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.013000 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.012986    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"} err="failed to get container status \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist"
Jul 10 13:53:17.013037 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013000    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.013187 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013169    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"} err="failed to get container status \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist"
Jul 10 13:53:17.013259 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013188    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.013405 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013389    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"} err="failed to get container status \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist"
Jul 10 13:53:17.013450 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013406    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.013596 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013580    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"} err="failed to get container status \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist"
Jul 10 13:53:17.013637 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013595    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.013772 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013756    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"} err="failed to get container status \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist"
Jul 10 13:53:17.013825 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013773    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.013985 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013968    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"} err="failed to get container status \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist"
Jul 10 13:53:17.013985 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.013983    2561 scope.go:117] "RemoveContainer" containerID="62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"
Jul 10 13:53:17.014201 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014184    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1"} err="failed to get container status \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": rpc error: code = NotFound desc = could not find container \"62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1\": container with ID starting with 62b7ab6c5bb6db0a0041970c5a55bdc892d56beb13834acb8578faa970f131d1 not found: ID does not exist"
Jul 10 13:53:17.014249 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014203    2561 scope.go:117] "RemoveContainer" containerID="eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"
Jul 10 13:53:17.014404 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014388    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3"} err="failed to get container status \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": rpc error: code = NotFound desc = could not find container \"eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3\": container with ID starting with eee81aef4595a289f7f7ae9772c218e50cb78887044f3c8b3d27a7060b7085e3 not found: ID does not exist"
Jul 10 13:53:17.014462 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014404    2561 scope.go:117] "RemoveContainer" containerID="9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"
Jul 10 13:53:17.014644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014626    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319"} err="failed to get container status \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": rpc error: code = NotFound desc = could not find container \"9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319\": container with ID starting with 9cd94f50f1b40f3211c116fb0e33c8730c8ad26ea22de68a0d96546b93c23319 not found: ID does not exist"
Jul 10 13:53:17.014644 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014644    2561 scope.go:117] "RemoveContainer" containerID="896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"
Jul 10 13:53:17.014844 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014829    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003"} err="failed to get container status \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": rpc error: code = NotFound desc = could not find container \"896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003\": container with ID starting with 896590bd5e9a48259c687aba1ee5ce4c2f10fa24cca1fc9ec46be6824f8f3003 not found: ID does not exist"
Jul 10 13:53:17.014885 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.014844    2561 scope.go:117] "RemoveContainer" containerID="15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"
Jul 10 13:53:17.015071 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.015030    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45"} err="failed to get container status \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": rpc error: code = NotFound desc = could not find container \"15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45\": container with ID starting with 15b6059088b99e54f896f77f5283b96f5f7ae24b50e6635ee654d32a0c7dbe45 not found: ID does not exist"
Jul 10 13:53:17.015071 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.015069    2561 scope.go:117] "RemoveContainer" containerID="84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"
Jul 10 13:53:17.015283 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.015267    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2"} err="failed to get container status \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": rpc error: code = NotFound desc = could not find container \"84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2\": container with ID starting with 84ee80d0bc86a9ddce977d92c9f8a250d3b1b00ef2ee5d4a706a57e7a0e876f2 not found: ID does not exist"
Jul 10 13:53:17.015324 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.015283    2561 scope.go:117] "RemoveContainer" containerID="4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"
Jul 10 13:53:17.015499 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.015481    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88"} err="failed to get container status \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": rpc error: code = NotFound desc = could not find container \"4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88\": container with ID starting with 4acaf6117b570f12a9aea590ffcc260116571eda85fa43a79dc4be5748977e88 not found: ID does not exist"
Jul 10 13:53:17.016168 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.016155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.020455 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.020441    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 13:53:17.020521 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.020447    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbptv\""
Jul 10 13:53:17.020584 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.020568    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 13:53:17.021983 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.021962    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 13:53:17.022217 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.022201    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 13:53:17.022996 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.022592    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 13:53:17.022996 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.022649    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 13:53:17.022996 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.022808    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 13:53:17.022996 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.022824    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9snls2q28l1gq\""
Jul 10 13:53:17.022996 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.022868    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 13:53:17.026157 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.026141    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 13:53:17.026240 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.026193    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 13:53:17.028962 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.028948    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 13:53:17.030270 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.030255    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 13:53:17.030316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.030266    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 13:53:17.032373 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.032354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 13:53:17.033998 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.033982    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 13:53:17.053267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.053239    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:53:17.144089 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.144036    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bcc48d0-2508-436d-999f-4b620b5a1c9b" path="/var/lib/kubelet/pods/2bcc48d0-2508-436d-999f-4b620b5a1c9b/volumes"
Jul 10 13:53:17.168756 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168756 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-web-config\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168970 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168970 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168970 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f748d9-c66b-47b4-af65-7a8e11710f4e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168970 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168902    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168970 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.168970 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.168991    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-config\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169269 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtzh\" (UniqueName: \"kubernetes.io/projected/57f748d9-c66b-47b4-af65-7a8e11710f4e-kube-api-access-mgtzh\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169594 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169594 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f748d9-c66b-47b4-af65-7a8e11710f4e-config-out\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.169594 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.169340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270322 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270322 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270322 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-config\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtzh\" (UniqueName: \"kubernetes.io/projected/57f748d9-c66b-47b4-af65-7a8e11710f4e-kube-api-access-mgtzh\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f748d9-c66b-47b4-af65-7a8e11710f4e-config-out\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-web-config\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.270705 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f748d9-c66b-47b4-af65-7a8e11710f4e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270864    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.270938    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.271188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271351 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.271199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.271727 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.271546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.273754 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.273592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-config\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274369 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274369 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274070    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274369 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274249    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57f748d9-c66b-47b4-af65-7a8e11710f4e-config-out\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274369 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274642 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274642 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274642 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.274807 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.274689    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.275377 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.275350    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57f748d9-c66b-47b4-af65-7a8e11710f4e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.275509 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.275488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.276514 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.276495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.276599 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.276548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-web-config\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.276977 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.276947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57f748d9-c66b-47b4-af65-7a8e11710f4e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.277075 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.277012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57f748d9-c66b-47b4-af65-7a8e11710f4e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.282835 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.282810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtzh\" (UniqueName: \"kubernetes.io/projected/57f748d9-c66b-47b4-af65-7a8e11710f4e-kube-api-access-mgtzh\") pod \"prometheus-k8s-0\" (UID: \"57f748d9-c66b-47b4-af65-7a8e11710f4e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.325967 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.325926    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:53:17.468836 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.468774    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 13:53:17.471364 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:53:17.471341    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f748d9_c66b_47b4_af65_7a8e11710f4e.slice/crio-0b81dbfd7c15ee428441a141011c1c0e63289e5e153254ee8099fdbf6e008366 WatchSource:0}: Error finding container 0b81dbfd7c15ee428441a141011c1c0e63289e5e153254ee8099fdbf6e008366: Status 404 returned error can't find the container with id 0b81dbfd7c15ee428441a141011c1c0e63289e5e153254ee8099fdbf6e008366
Jul 10 13:53:17.955289 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.955250    2561 generic.go:356] "Generic (PLEG): container finished" podID="57f748d9-c66b-47b4-af65-7a8e11710f4e" containerID="c794fc99f276c147a00581a3f2a29ba43af8f1b548826311259aaba840502bd4" exitCode=0
Jul 10 13:53:17.955703 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.955335    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerDied","Data":"c794fc99f276c147a00581a3f2a29ba43af8f1b548826311259aaba840502bd4"}
Jul 10 13:53:17.955703 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:17.955404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"0b81dbfd7c15ee428441a141011c1c0e63289e5e153254ee8099fdbf6e008366"}
Jul 10 13:53:18.963580 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:18.963546    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"a6c4ef2c27bb494d44db9874999fb794eacaf3f908139c2c1213a95487747644"}
Jul 10 13:53:18.963960 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:18.963638    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"1c3aed8ac36a76055411f4757b2286e810bbc8c28bc8c8fe470d989a24488dfb"}
Jul 10 13:53:18.963960 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:18.963664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"3461c85927ccded177ee1e4a1d6610b337fdcd5f939c06ac8d76d2532ef2a344"}
Jul 10 13:53:18.963960 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:18.963703    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"38bd42f02e9be761b31fe2dac99da3fa00907f261ee4ce2875135f4cb23934f1"}
Jul 10 13:53:18.963960 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:18.963731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"9792cf373f48b5434622d0e75a3287ff148c394302aa37caaf243a696352b8f9"}
Jul 10 13:53:18.963960 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:18.963753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57f748d9-c66b-47b4-af65-7a8e11710f4e","Type":"ContainerStarted","Data":"4dba2833310fa8a1ad34a8c86f65bc13669dcbb68443f988bdc778f526cc8275"}
Jul 10 13:53:19.020460 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:19.020398    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.000328817 podStartE2EDuration="3.020381661s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.052844ms" isStatefulPod=false podCreationTimestamp="2026-07-10 13:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:53:19.019676275 +0000 UTC m=+174.403875189" watchObservedRunningTime="2026-07-10 13:53:19.020381661 +0000 UTC m=+174.404580580"
Jul 10 13:53:22.327104 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:53:22.327071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:54:17.326843 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:54:17.326800    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:54:17.342831 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:54:17.342804    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:54:18.206062 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:54:18.206022    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 13:55:25.004514 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:25.004486    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 13:55:43.250179 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.250146    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"]
Jul 10 13:55:43.252276 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.252257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.254477 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.254455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 13:55:43.254598 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.254493    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 13:55:43.254598 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.254568    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k9vzt\""
Jul 10 13:55:43.254718 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.254682    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 13:55:43.254883 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.254871    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 13:55:43.268485 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.268457    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"]
Jul 10 13:55:43.343762 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.343725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-webhook-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.343959 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.343772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-manifests\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.343959 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.343822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.343959 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.343849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-tmp\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.343959 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.343876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jrn\" (UniqueName: \"kubernetes.io/projected/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-kube-api-access-76jrn\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.444662 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.444623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-webhook-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.444662 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.444669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-manifests\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.444923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.444687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.444923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.444709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-tmp\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.444923 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.444729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jrn\" (UniqueName: \"kubernetes.io/projected/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-kube-api-access-76jrn\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.445240 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.445218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-manifests\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.447268 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.447239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-webhook-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.447469 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.447451    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-tmp\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.447588 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.447568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.453350 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.453325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jrn\" (UniqueName: \"kubernetes.io/projected/0992a7b2-5bed-41af-9a1f-f0ab430f7c41-kube-api-access-76jrn\") pod \"opendatahub-operator-controller-manager-545b4db9db-ml29k\" (UID: \"0992a7b2-5bed-41af-9a1f-f0ab430f7c41\") " pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.562306 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.562269    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:43.697632 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.697535    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"]
Jul 10 13:55:43.702030 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:55:43.701988    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0992a7b2_5bed_41af_9a1f_f0ab430f7c41.slice/crio-e32e74f56dcf0ecd71b5880f7091a7d574b933a639a9d197d064119e6f07bc55 WatchSource:0}: Error finding container e32e74f56dcf0ecd71b5880f7091a7d574b933a639a9d197d064119e6f07bc55: Status 404 returned error can't find the container with id e32e74f56dcf0ecd71b5880f7091a7d574b933a639a9d197d064119e6f07bc55
Jul 10 13:55:43.703958 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:43.703938    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 13:55:44.533622 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:44.533579    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k" event={"ID":"0992a7b2-5bed-41af-9a1f-f0ab430f7c41","Type":"ContainerStarted","Data":"e32e74f56dcf0ecd71b5880f7091a7d574b933a639a9d197d064119e6f07bc55"}
Jul 10 13:55:47.549812 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:47.549781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k" event={"ID":"0992a7b2-5bed-41af-9a1f-f0ab430f7c41","Type":"ContainerStarted","Data":"46d88d546351c2166fa9d1320147e3825d9a5560856520c507f2d71b2bdeaa13"}
Jul 10 13:55:48.555258 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:48.555224    2561 generic.go:356] "Generic (PLEG): container finished" podID="0992a7b2-5bed-41af-9a1f-f0ab430f7c41" containerID="46d88d546351c2166fa9d1320147e3825d9a5560856520c507f2d71b2bdeaa13" exitCode=0
Jul 10 13:55:48.555639 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:48.555302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k" event={"ID":"0992a7b2-5bed-41af-9a1f-f0ab430f7c41","Type":"ContainerDied","Data":"46d88d546351c2166fa9d1320147e3825d9a5560856520c507f2d71b2bdeaa13"}
Jul 10 13:55:49.566811 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:49.566773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k" event={"ID":"0992a7b2-5bed-41af-9a1f-f0ab430f7c41","Type":"ContainerStarted","Data":"9dea354e525362c0daa00468f38b429bbeae464d57d5522150eb271704d88ccb"}
Jul 10 13:55:49.567231 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:49.566907    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:55:49.597400 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:55:49.597352    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k" podStartSLOduration=2.066628966 podStartE2EDuration="6.597334782s" totalImagesPullingTime="3.513558458s" totalInitContainerRuntime="1.017147358s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:55:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:55:49.595082331 +0000 UTC m=+324.979281251" watchObservedRunningTime="2026-07-10 13:55:49.597334782 +0000 UTC m=+324.981533701"
Jul 10 13:56:00.573288 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:00.573257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-545b4db9db-ml29k"
Jul 10 13:56:04.007160 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.007125    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"]
Jul 10 13:56:04.016472 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.016448    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.019309 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.019280    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-grwqt\""
Jul 10 13:56:04.019458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.019280    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 13:56:04.019458 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.019349    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 13:56:04.019623 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.019608    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 13:56:04.019670 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.019607    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 13:56:04.031316 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.031293    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"]
Jul 10 13:56:04.118252 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.118219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-tls-certs\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.118252 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.118254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsz9d\" (UniqueName: \"kubernetes.io/projected/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-kube-api-access-vsz9d\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.118476 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.118287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-tmp\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.189814 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.189780    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9fc2g"]
Jul 10 13:56:04.192172 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.192153    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.194554 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.194538    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 10 13:56:04.194625 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.194540    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pnbtz\""
Jul 10 13:56:04.203764 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.203737    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9fc2g"]
Jul 10 13:56:04.219718 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.219686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-tls-certs\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.219718 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.219722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsz9d\" (UniqueName: \"kubernetes.io/projected/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-kube-api-access-vsz9d\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.219907 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.219752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-tmp\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.222038 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.222012    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-tmp\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.222191 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.222173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-tls-certs\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.228232 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.228207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsz9d\" (UniqueName: \"kubernetes.io/projected/1b41749d-5b5b-4db5-bd17-9781bd8f41fe-kube-api-access-vsz9d\") pod \"kube-auth-proxy-6c9db8d9c-rnf8s\" (UID: \"1b41749d-5b5b-4db5-bd17-9781bd8f41fe\") " pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.320490 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.320453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76586a68-5c7d-48aa-a520-49313a3a9ba7-cert\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.320700 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.320525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nztz6\" (UniqueName: \"kubernetes.io/projected/76586a68-5c7d-48aa-a520-49313a3a9ba7-kube-api-access-nztz6\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.326336 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.326314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"
Jul 10 13:56:04.421683 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.421655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76586a68-5c7d-48aa-a520-49313a3a9ba7-cert\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.421850 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.421705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nztz6\" (UniqueName: \"kubernetes.io/projected/76586a68-5c7d-48aa-a520-49313a3a9ba7-kube-api-access-nztz6\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.421850 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:56:04.421820    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 10 13:56:04.421962 ip-10-0-129-218 kubenswrapper[2561]: E0710 13:56:04.421890    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76586a68-5c7d-48aa-a520-49313a3a9ba7-cert podName:76586a68-5c7d-48aa-a520-49313a3a9ba7 nodeName:}" failed. No retries permitted until 2026-07-10 13:56:04.921872056 +0000 UTC m=+340.306070971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/76586a68-5c7d-48aa-a520-49313a3a9ba7-cert") pod "odh-model-controller-7998c67dc4-9fc2g" (UID: "76586a68-5c7d-48aa-a520-49313a3a9ba7") : secret "odh-model-controller-webhook-cert" not found
Jul 10 13:56:04.432741 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.432707    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nztz6\" (UniqueName: \"kubernetes.io/projected/76586a68-5c7d-48aa-a520-49313a3a9ba7-kube-api-access-nztz6\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.461726 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.461692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s"]
Jul 10 13:56:04.464954 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:56:04.464919    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b41749d_5b5b_4db5_bd17_9781bd8f41fe.slice/crio-198ffc9c5cc21bcf41359b11aafca65c2f08f68812a100b76f4126036de49c8f WatchSource:0}: Error finding container 198ffc9c5cc21bcf41359b11aafca65c2f08f68812a100b76f4126036de49c8f: Status 404 returned error can't find the container with id 198ffc9c5cc21bcf41359b11aafca65c2f08f68812a100b76f4126036de49c8f
Jul 10 13:56:04.632082 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.631977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s" event={"ID":"1b41749d-5b5b-4db5-bd17-9781bd8f41fe","Type":"ContainerStarted","Data":"198ffc9c5cc21bcf41359b11aafca65c2f08f68812a100b76f4126036de49c8f"}
Jul 10 13:56:04.926799 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.926709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76586a68-5c7d-48aa-a520-49313a3a9ba7-cert\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:04.929242 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:04.929217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76586a68-5c7d-48aa-a520-49313a3a9ba7-cert\") pod \"odh-model-controller-7998c67dc4-9fc2g\" (UID: \"76586a68-5c7d-48aa-a520-49313a3a9ba7\") " pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:05.101831 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:05.101793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:05.256153 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:05.256117    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9fc2g"]
Jul 10 13:56:05.259314 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:56:05.259282    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76586a68_5c7d_48aa_a520_49313a3a9ba7.slice/crio-5fbd1c1bfaa833e34d73f653abf0893d2957d556ebc7efbf2cc170fc5bfb1315 WatchSource:0}: Error finding container 5fbd1c1bfaa833e34d73f653abf0893d2957d556ebc7efbf2cc170fc5bfb1315: Status 404 returned error can't find the container with id 5fbd1c1bfaa833e34d73f653abf0893d2957d556ebc7efbf2cc170fc5bfb1315
Jul 10 13:56:05.639037 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:05.638977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g" event={"ID":"76586a68-5c7d-48aa-a520-49313a3a9ba7","Type":"ContainerStarted","Data":"5fbd1c1bfaa833e34d73f653abf0893d2957d556ebc7efbf2cc170fc5bfb1315"}
Jul 10 13:56:08.654591 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:08.654536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g" event={"ID":"76586a68-5c7d-48aa-a520-49313a3a9ba7","Type":"ContainerStarted","Data":"11f05d1740a1b62002b4b9ac3f0ee876bc010c425612e18accb57648ecd72b37"}
Jul 10 13:56:08.655019 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:08.654628    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:08.656307 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:08.656276    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s" event={"ID":"1b41749d-5b5b-4db5-bd17-9781bd8f41fe","Type":"ContainerStarted","Data":"b16886719712184b023ce41478f96c080b09286c9fc07fc67171999c772c0700"}
Jul 10 13:56:08.674921 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:08.674872    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g" podStartSLOduration=1.364345739 podStartE2EDuration="4.674856721s" totalImagesPullingTime="3.310510982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:08.673531711 +0000 UTC m=+344.057730634" watchObservedRunningTime="2026-07-10 13:56:08.674856721 +0000 UTC m=+344.059055639"
Jul 10 13:56:08.695574 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:08.695526    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c9db8d9c-rnf8s" podStartSLOduration=1.596189748 podStartE2EDuration="5.695508658s" totalImagesPullingTime="4.09931891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:08.691711261 +0000 UTC m=+344.075910181" watchObservedRunningTime="2026-07-10 13:56:08.695508658 +0000 UTC m=+344.079707577"
Jul 10 13:56:11.872894 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.872857    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"]
Jul 10 13:56:11.876361 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.876345    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.882211 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.882183    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 13:56:11.882363 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.882278    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:56:11.882363 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.882302    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m2wwt\""
Jul 10 13:56:11.882801 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.882592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 13:56:11.882877 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.882827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 13:56:11.900443 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.900410    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"]
Jul 10 13:56:11.989151 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.989151 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.989410 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.989410 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.989410 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.989410 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlpd\" (UniqueName: \"kubernetes.io/projected/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-kube-api-access-hrlpd\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:11.989560 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:11.989435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.054110 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.054078    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"]
Jul 10 13:56:12.057303 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.057287    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.060151 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.060129    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 13:56:12.060308 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.060213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 13:56:12.060396 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.060360    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 13:56:12.062569 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.062530    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 13:56:12.062569 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.062547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 13:56:12.062762 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.062650    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m8j48\""
Jul 10 13:56:12.070490 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.070468    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"]
Jul 10 13:56:12.090306 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.090447 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.090447 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.090447 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.090447 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.090674 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlpd\" (UniqueName: \"kubernetes.io/projected/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-kube-api-access-hrlpd\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.090674 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.090544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.091266 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.091239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.092632 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.092603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.092787 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.092767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.092875 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.092857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.092935 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.092894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.114118 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.114095    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlpd\" (UniqueName: \"kubernetes.io/projected/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-kube-api-access-hrlpd\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.114234 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.114177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79e558fc-aa86-400e-a9ce-81fd5fb7a25d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wjgzc\" (UID: \"79e558fc-aa86-400e-a9ce-81fd5fb7a25d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.185784 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.185680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:12.191175 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.191089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btzsx\" (UniqueName: \"kubernetes.io/projected/05693ae0-146e-4fda-9922-de256a02d365-kube-api-access-btzsx\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.191175 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.191174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05693ae0-146e-4fda-9922-de256a02d365-metrics-cert\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.191342 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.191233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05693ae0-146e-4fda-9922-de256a02d365-manager-config\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.191342 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.191275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05693ae0-146e-4fda-9922-de256a02d365-cert\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.292099 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.292033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btzsx\" (UniqueName: \"kubernetes.io/projected/05693ae0-146e-4fda-9922-de256a02d365-kube-api-access-btzsx\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.292267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.292122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05693ae0-146e-4fda-9922-de256a02d365-metrics-cert\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.292267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.292169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05693ae0-146e-4fda-9922-de256a02d365-manager-config\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.292267 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.292195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05693ae0-146e-4fda-9922-de256a02d365-cert\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.293010 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.292981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05693ae0-146e-4fda-9922-de256a02d365-manager-config\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.294953 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.294930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05693ae0-146e-4fda-9922-de256a02d365-metrics-cert\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.295308 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.295284    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05693ae0-146e-4fda-9922-de256a02d365-cert\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.300891 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.300864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btzsx\" (UniqueName: \"kubernetes.io/projected/05693ae0-146e-4fda-9922-de256a02d365-kube-api-access-btzsx\") pod \"lws-controller-manager-745c8d65dc-5bhvk\" (UID: \"05693ae0-146e-4fda-9922-de256a02d365\") " pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.329934 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.329906    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"]
Jul 10 13:56:12.366959 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.366929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:12.519436 ip-10-0-129-218 kubenswrapper[2561]: W0710 13:56:12.519407    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05693ae0_146e_4fda_9922_de256a02d365.slice/crio-5f355eb593b218900c9e5b8d64236358274d8bfee054f7f6608ab67fc0c0965a WatchSource:0}: Error finding container 5f355eb593b218900c9e5b8d64236358274d8bfee054f7f6608ab67fc0c0965a: Status 404 returned error can't find the container with id 5f355eb593b218900c9e5b8d64236358274d8bfee054f7f6608ab67fc0c0965a
Jul 10 13:56:12.523084 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.523062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"]
Jul 10 13:56:12.675118 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.675085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc" event={"ID":"79e558fc-aa86-400e-a9ce-81fd5fb7a25d","Type":"ContainerStarted","Data":"049f07dab535fa975d46b4f30cd7538602d8f4944b21e319e57d5b9171e9809a"}
Jul 10 13:56:12.676180 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:12.676156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk" event={"ID":"05693ae0-146e-4fda-9922-de256a02d365","Type":"ContainerStarted","Data":"5f355eb593b218900c9e5b8d64236358274d8bfee054f7f6608ab67fc0c0965a"}
Jul 10 13:56:16.271652 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.271610    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 13:56:16.271922 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.271690    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 10 13:56:16.700867 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.700829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc" event={"ID":"79e558fc-aa86-400e-a9ce-81fd5fb7a25d","Type":"ContainerStarted","Data":"ad4a7dd1d8e1d0dca08dec8957cc10878725142d3285c3371db6f31f5bec67ad"}
Jul 10 13:56:16.701081 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.700917    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:16.702483 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.702451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk" event={"ID":"05693ae0-146e-4fda-9922-de256a02d365","Type":"ContainerStarted","Data":"853ae7a58070b1738ee3acf49c459e0db3708ea94452088b917715383d7584dd"}
Jul 10 13:56:16.702580 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.702568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 13:56:16.722337 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.722281    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc" podStartSLOduration=1.78087317 podStartE2EDuration="5.722265626s" totalImagesPullingTime="3.941392456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:16.721294921 +0000 UTC m=+352.105493842" watchObservedRunningTime="2026-07-10 13:56:16.722265626 +0000 UTC m=+352.106464546"
Jul 10 13:56:16.738369 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:16.738323    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk" podStartSLOduration=0.932620408 podStartE2EDuration="4.738309231s" totalImagesPullingTime="3.805688823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:56:16.737010898 +0000 UTC m=+352.121209819" watchObservedRunningTime="2026-07-10 13:56:16.738309231 +0000 UTC m=+352.122508150"
Jul 10 13:56:17.712585 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:17.712513    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wjgzc"
Jul 10 13:56:19.663211 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:19.663174    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9fc2g"
Jul 10 13:56:27.714308 ip-10-0-129-218 kubenswrapper[2561]: I0710 13:56:27.714278    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-745c8d65dc-5bhvk"
Jul 10 14:16:02.309418 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.309381    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"]
Jul 10 14:16:02.313401 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.313377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.315857 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.315833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b78b9ecf-serving-cert\""
Jul 10 14:16:02.316002 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.315928    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:16:02.316860 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.316840    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:16:02.316860 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.316862    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:16:02.324490 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.324461    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"]
Jul 10 14:16:02.437433 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.437399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/375755b9-51a3-434f-ad30-68314aff4cf2-maas-api-tls\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.437607 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.437439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/375755b9-51a3-434f-ad30-68314aff4cf2-openshift-service-ca\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.437607 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.437529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kvgg\" (UniqueName: \"kubernetes.io/projected/375755b9-51a3-434f-ad30-68314aff4cf2-kube-api-access-4kvgg\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.538687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.538655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/375755b9-51a3-434f-ad30-68314aff4cf2-maas-api-tls\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.538687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.538694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/375755b9-51a3-434f-ad30-68314aff4cf2-openshift-service-ca\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.538939 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.538829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kvgg\" (UniqueName: \"kubernetes.io/projected/375755b9-51a3-434f-ad30-68314aff4cf2-kube-api-access-4kvgg\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.539421 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.539403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/375755b9-51a3-434f-ad30-68314aff4cf2-openshift-service-ca\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.541061 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.541026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/375755b9-51a3-434f-ad30-68314aff4cf2-maas-api-tls\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.547090 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.547068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kvgg\" (UniqueName: \"kubernetes.io/projected/375755b9-51a3-434f-ad30-68314aff4cf2-kube-api-access-4kvgg\") pod \"maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.624416 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.624319    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:02.756041 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.756007    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"]
Jul 10 14:16:02.758648 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:16:02.758622    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375755b9_51a3_434f_ad30_68314aff4cf2.slice/crio-6882a1aef6874759cb816b4b13a6bb86f09c5b22eda58a45d2945a33df2f4a48 WatchSource:0}: Error finding container 6882a1aef6874759cb816b4b13a6bb86f09c5b22eda58a45d2945a33df2f4a48: Status 404 returned error can't find the container with id 6882a1aef6874759cb816b4b13a6bb86f09c5b22eda58a45d2945a33df2f4a48
Jul 10 14:16:02.760122 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.760107    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:16:02.991133 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:02.991032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7" event={"ID":"375755b9-51a3-434f-ad30-68314aff4cf2","Type":"ContainerStarted","Data":"6882a1aef6874759cb816b4b13a6bb86f09c5b22eda58a45d2945a33df2f4a48"}
Jul 10 14:16:06.007831 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:06.007789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7" event={"ID":"375755b9-51a3-434f-ad30-68314aff4cf2","Type":"ContainerStarted","Data":"cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812"}
Jul 10 14:16:06.008281 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:06.007893    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:16:06.031807 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:06.031763    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7" podStartSLOduration=1.485725102 podStartE2EDuration="4.031748756s" totalImagesPullingTime="2.546023654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:16:06.030768138 +0000 UTC m=+1541.414967059" watchObservedRunningTime="2026-07-10 14:16:06.031748756 +0000 UTC m=+1541.415947675"
Jul 10 14:16:12.018346 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:16:12.018314    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:17:07.816302 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:07.816264    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"]
Jul 10 14:17:07.816805 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:07.816490    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7" podUID="375755b9-51a3-434f-ad30-68314aff4cf2" containerName="maas-api" containerID="cri-o://cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812" gracePeriod=30
Jul 10 14:17:08.059521 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.059496    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:17:08.147607 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.147529    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/375755b9-51a3-434f-ad30-68314aff4cf2-maas-api-tls\") pod \"375755b9-51a3-434f-ad30-68314aff4cf2\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") "
Jul 10 14:17:08.147607 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.147597    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kvgg\" (UniqueName: \"kubernetes.io/projected/375755b9-51a3-434f-ad30-68314aff4cf2-kube-api-access-4kvgg\") pod \"375755b9-51a3-434f-ad30-68314aff4cf2\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") "
Jul 10 14:17:08.147795 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.147734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/375755b9-51a3-434f-ad30-68314aff4cf2-openshift-service-ca\") pod \"375755b9-51a3-434f-ad30-68314aff4cf2\" (UID: \"375755b9-51a3-434f-ad30-68314aff4cf2\") "
Jul 10 14:17:08.148085 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.148060    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/375755b9-51a3-434f-ad30-68314aff4cf2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "375755b9-51a3-434f-ad30-68314aff4cf2" (UID: "375755b9-51a3-434f-ad30-68314aff4cf2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:17:08.149757 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.149735    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375755b9-51a3-434f-ad30-68314aff4cf2-kube-api-access-4kvgg" (OuterVolumeSpecName: "kube-api-access-4kvgg") pod "375755b9-51a3-434f-ad30-68314aff4cf2" (UID: "375755b9-51a3-434f-ad30-68314aff4cf2"). InnerVolumeSpecName "kube-api-access-4kvgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:17:08.149856 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.149763    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/375755b9-51a3-434f-ad30-68314aff4cf2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "375755b9-51a3-434f-ad30-68314aff4cf2" (UID: "375755b9-51a3-434f-ad30-68314aff4cf2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:17:08.249418 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.249368    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kvgg\" (UniqueName: \"kubernetes.io/projected/375755b9-51a3-434f-ad30-68314aff4cf2-kube-api-access-4kvgg\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:17:08.249418 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.249409    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/375755b9-51a3-434f-ad30-68314aff4cf2-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:17:08.249418 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.249424    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/375755b9-51a3-434f-ad30-68314aff4cf2-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:17:08.292364 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.292333    2561 generic.go:356] "Generic (PLEG): container finished" podID="375755b9-51a3-434f-ad30-68314aff4cf2" containerID="cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812" exitCode=0
Jul 10 14:17:08.292535 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.292378    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"
Jul 10 14:17:08.292535 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.292382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7" event={"ID":"375755b9-51a3-434f-ad30-68314aff4cf2","Type":"ContainerDied","Data":"cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812"}
Jul 10 14:17:08.292535 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.292483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7" event={"ID":"375755b9-51a3-434f-ad30-68314aff4cf2","Type":"ContainerDied","Data":"6882a1aef6874759cb816b4b13a6bb86f09c5b22eda58a45d2945a33df2f4a48"}
Jul 10 14:17:08.292535 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.292504    2561 scope.go:117] "RemoveContainer" containerID="cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812"
Jul 10 14:17:08.301574 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.301558    2561 scope.go:117] "RemoveContainer" containerID="cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812"
Jul 10 14:17:08.301840 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:17:08.301822    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812\": container with ID starting with cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812 not found: ID does not exist" containerID="cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812"
Jul 10 14:17:08.301894 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.301849    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812"} err="failed to get container status \"cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812\": rpc error: code = NotFound desc = could not find container \"cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812\": container with ID starting with cfd4d7ae50ea58ec6a9e17fb5f2a8862f458a3e25fd67797989636bb871ed812 not found: ID does not exist"
Jul 10 14:17:08.316865 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.316837    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"]
Jul 10 14:17:08.320030 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:08.320010    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b78b9ecf-865dc867d-s95r7"]
Jul 10 14:17:09.141727 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:09.141694    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="375755b9-51a3-434f-ad30-68314aff4cf2" path="/var/lib/kubelet/pods/375755b9-51a3-434f-ad30-68314aff4cf2/volumes"
Jul 10 14:17:24.396609 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.396578    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"]
Jul 10 14:17:24.397135 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.396926    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375755b9-51a3-434f-ad30-68314aff4cf2" containerName="maas-api"
Jul 10 14:17:24.397135 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.396939    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="375755b9-51a3-434f-ad30-68314aff4cf2" containerName="maas-api"
Jul 10 14:17:24.397135 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.397003    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="375755b9-51a3-434f-ad30-68314aff4cf2" containerName="maas-api"
Jul 10 14:17:24.400102 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.400079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.403619 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.403593    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-561ce10f-serving-cert\""
Jul 10 14:17:24.404502 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.404479    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:17:24.404622 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.404551    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:17:24.404622 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.404551    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:17:24.412749 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.412727    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"]
Jul 10 14:17:24.497398 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.497360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-openshift-service-ca\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.497586 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.497407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwfk8\" (UniqueName: \"kubernetes.io/projected/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-kube-api-access-bwfk8\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.497586 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.497505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.598373 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.598322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-openshift-service-ca\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.598373 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.598380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwfk8\" (UniqueName: \"kubernetes.io/projected/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-kube-api-access-bwfk8\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.598644 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.598441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.598644 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:17:24.598537    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-serving-cert: secret "maas-api-e2e-ait-561ce10f-serving-cert" not found
Jul 10 14:17:24.598644 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:17:24.598601    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls podName:4fbb296a-3509-4c02-b1e1-7ec96a7fb687 nodeName:}" failed. No retries permitted until 2026-07-10 14:17:25.098584224 +0000 UTC m=+1620.482783122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls") pod "maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" (UID: "4fbb296a-3509-4c02-b1e1-7ec96a7fb687") : secret "maas-api-e2e-ait-561ce10f-serving-cert" not found
Jul 10 14:17:24.599118 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.599096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-openshift-service-ca\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:24.610471 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:24.610445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwfk8\" (UniqueName: \"kubernetes.io/projected/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-kube-api-access-bwfk8\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:25.102660 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:25.102614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:25.105097 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:25.105069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls\") pod \"maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:25.313784 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:25.313743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:17:25.321839 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:25.321817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:25.456668 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:25.456634    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"]
Jul 10 14:17:25.460115 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:17:25.460087    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbb296a_3509_4c02_b1e1_7ec96a7fb687.slice/crio-4240cef877a57282d7542447042b0db906d8e0412ab2eddc3d76461d3e3f1df8 WatchSource:0}: Error finding container 4240cef877a57282d7542447042b0db906d8e0412ab2eddc3d76461d3e3f1df8: Status 404 returned error can't find the container with id 4240cef877a57282d7542447042b0db906d8e0412ab2eddc3d76461d3e3f1df8
Jul 10 14:17:26.377913 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:26.377866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" event={"ID":"4fbb296a-3509-4c02-b1e1-7ec96a7fb687","Type":"ContainerStarted","Data":"315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f"}
Jul 10 14:17:26.378136 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:26.377933    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" event={"ID":"4fbb296a-3509-4c02-b1e1-7ec96a7fb687","Type":"ContainerStarted","Data":"4240cef877a57282d7542447042b0db906d8e0412ab2eddc3d76461d3e3f1df8"}
Jul 10 14:17:26.378136 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:26.378042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:17:26.396648 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:26.396599    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" podStartSLOduration=1.8560497040000001 podStartE2EDuration="2.396581413s" totalImagesPullingTime="540.531709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:17:26.395382619 +0000 UTC m=+1621.779581541" watchObservedRunningTime="2026-07-10 14:17:26.396581413 +0000 UTC m=+1621.780780332"
Jul 10 14:17:32.390138 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:17:32.390111    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:18:29.764487 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:29.764450    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"]
Jul 10 14:18:29.765147 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:29.764661    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" podUID="4fbb296a-3509-4c02-b1e1-7ec96a7fb687" containerName="maas-api" containerID="cri-o://315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f" gracePeriod=30
Jul 10 14:18:30.010731 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.010706    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:18:30.084320 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.084278    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-openshift-service-ca\") pod \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") "
Jul 10 14:18:30.084320 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.084320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwfk8\" (UniqueName: \"kubernetes.io/projected/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-kube-api-access-bwfk8\") pod \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") "
Jul 10 14:18:30.084580 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.084420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls\") pod \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\" (UID: \"4fbb296a-3509-4c02-b1e1-7ec96a7fb687\") "
Jul 10 14:18:30.084694 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.084667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4fbb296a-3509-4c02-b1e1-7ec96a7fb687" (UID: "4fbb296a-3509-4c02-b1e1-7ec96a7fb687"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:18:30.084794 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.084764    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:18:30.086472 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.086448    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-kube-api-access-bwfk8" (OuterVolumeSpecName: "kube-api-access-bwfk8") pod "4fbb296a-3509-4c02-b1e1-7ec96a7fb687" (UID: "4fbb296a-3509-4c02-b1e1-7ec96a7fb687"). InnerVolumeSpecName "kube-api-access-bwfk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:18:30.086577 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.086533    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4fbb296a-3509-4c02-b1e1-7ec96a7fb687" (UID: "4fbb296a-3509-4c02-b1e1-7ec96a7fb687"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:18:30.185239 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.185201    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwfk8\" (UniqueName: \"kubernetes.io/projected/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-kube-api-access-bwfk8\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:18:30.185239 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.185232    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fbb296a-3509-4c02-b1e1-7ec96a7fb687-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:18:30.674150 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.674115    2561 generic.go:356] "Generic (PLEG): container finished" podID="4fbb296a-3509-4c02-b1e1-7ec96a7fb687" containerID="315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f" exitCode=0
Jul 10 14:18:30.674363 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.674155    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"
Jul 10 14:18:30.674363 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.674207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" event={"ID":"4fbb296a-3509-4c02-b1e1-7ec96a7fb687","Type":"ContainerDied","Data":"315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f"}
Jul 10 14:18:30.674363 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.674267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2" event={"ID":"4fbb296a-3509-4c02-b1e1-7ec96a7fb687","Type":"ContainerDied","Data":"4240cef877a57282d7542447042b0db906d8e0412ab2eddc3d76461d3e3f1df8"}
Jul 10 14:18:30.674363 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.674300    2561 scope.go:117] "RemoveContainer" containerID="315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f"
Jul 10 14:18:30.685268 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.685250    2561 scope.go:117] "RemoveContainer" containerID="315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f"
Jul 10 14:18:30.685537 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:18:30.685511    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f\": container with ID starting with 315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f not found: ID does not exist" containerID="315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f"
Jul 10 14:18:30.685596 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.685539    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f"} err="failed to get container status \"315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f\": rpc error: code = NotFound desc = could not find container \"315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f\": container with ID starting with 315910c0b5cbdd3b59a0608b43f77803969922c83d6ca83e0842c296eca18f6f not found: ID does not exist"
Jul 10 14:18:30.698210 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.698185    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"]
Jul 10 14:18:30.705249 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:30.705227    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-561ce10f-75d7d48df7-hxxm2"]
Jul 10 14:18:31.143639 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:31.143600    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fbb296a-3509-4c02-b1e1-7ec96a7fb687" path="/var/lib/kubelet/pods/4fbb296a-3509-4c02-b1e1-7ec96a7fb687/volumes"
Jul 10 14:18:47.036792 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.036755    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"]
Jul 10 14:18:47.037241 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.037127    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbb296a-3509-4c02-b1e1-7ec96a7fb687" containerName="maas-api"
Jul 10 14:18:47.037241 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.037140    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbb296a-3509-4c02-b1e1-7ec96a7fb687" containerName="maas-api"
Jul 10 14:18:47.037241 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.037222    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fbb296a-3509-4c02-b1e1-7ec96a7fb687" containerName="maas-api"
Jul 10 14:18:47.040211 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.040192    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.047178 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.047157    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:18:47.047286 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.047172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-cce0783f-serving-cert\""
Jul 10 14:18:47.047903 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.047888    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:18:47.047954 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.047930    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:18:47.077259 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.077225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"]
Jul 10 14:18:47.137610 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.137575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.137791 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.137622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd10436-533f-4f8e-a572-3535def66664-openshift-service-ca\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.137843 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.137776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpzj\" (UniqueName: \"kubernetes.io/projected/fdd10436-533f-4f8e-a572-3535def66664-kube-api-access-vbpzj\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.239290 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.239249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.239488 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.239298    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd10436-533f-4f8e-a572-3535def66664-openshift-service-ca\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.239488 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:18:47.239406    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-serving-cert: secret "maas-api-e2e-derive-cce0783f-serving-cert" not found
Jul 10 14:18:47.239488 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.239438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpzj\" (UniqueName: \"kubernetes.io/projected/fdd10436-533f-4f8e-a572-3535def66664-kube-api-access-vbpzj\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.239488 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:18:47.239481    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls podName:fdd10436-533f-4f8e-a572-3535def66664 nodeName:}" failed. No retries permitted until 2026-07-10 14:18:47.739461155 +0000 UTC m=+1703.123660058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls") pod "maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" (UID: "fdd10436-533f-4f8e-a572-3535def66664") : secret "maas-api-e2e-derive-cce0783f-serving-cert" not found
Jul 10 14:18:47.239975 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.239954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd10436-533f-4f8e-a572-3535def66664-openshift-service-ca\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.254325 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.254297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpzj\" (UniqueName: \"kubernetes.io/projected/fdd10436-533f-4f8e-a572-3535def66664-kube-api-access-vbpzj\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.743430 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.743395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.745733 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.745709    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls\") pod \"maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:47.950222 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:47.950188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:48.105486 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:48.105450    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"]
Jul 10 14:18:48.111744 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:18:48.111716    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd10436_533f_4f8e_a572_3535def66664.slice/crio-d1f05974c251ba9d10b74eab694612fc415f0ae15b563b0eb9d083bd72860e3e WatchSource:0}: Error finding container d1f05974c251ba9d10b74eab694612fc415f0ae15b563b0eb9d083bd72860e3e: Status 404 returned error can't find the container with id d1f05974c251ba9d10b74eab694612fc415f0ae15b563b0eb9d083bd72860e3e
Jul 10 14:18:48.763366 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:48.763330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" event={"ID":"fdd10436-533f-4f8e-a572-3535def66664","Type":"ContainerStarted","Data":"20ba47770d8547241e63c7eecdb4f96323898e0b505c09266eba247ea8f22f26"}
Jul 10 14:18:48.763568 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:48.763387    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" event={"ID":"fdd10436-533f-4f8e-a572-3535def66664","Type":"ContainerStarted","Data":"d1f05974c251ba9d10b74eab694612fc415f0ae15b563b0eb9d083bd72860e3e"}
Jul 10 14:18:48.763568 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:48.763417    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:18:48.786633 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:48.786577    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" podStartSLOduration=1.275026058 podStartE2EDuration="1.786555425s" totalImagesPullingTime="511.529367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:18:48.785607629 +0000 UTC m=+1704.169806549" watchObservedRunningTime="2026-07-10 14:18:48.786555425 +0000 UTC m=+1704.170754345"
Jul 10 14:18:54.775203 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:18:54.775171    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:20:01.891964 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:01.891925    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"]
Jul 10 14:20:01.893568 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:01.892159    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" podUID="fdd10436-533f-4f8e-a572-3535def66664" containerName="maas-api" containerID="cri-o://20ba47770d8547241e63c7eecdb4f96323898e0b505c09266eba247ea8f22f26" gracePeriod=30
Jul 10 14:20:02.097299 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.097267    2561 generic.go:356] "Generic (PLEG): container finished" podID="fdd10436-533f-4f8e-a572-3535def66664" containerID="20ba47770d8547241e63c7eecdb4f96323898e0b505c09266eba247ea8f22f26" exitCode=0
Jul 10 14:20:02.097480 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.097343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" event={"ID":"fdd10436-533f-4f8e-a572-3535def66664","Type":"ContainerDied","Data":"20ba47770d8547241e63c7eecdb4f96323898e0b505c09266eba247ea8f22f26"}
Jul 10 14:20:02.147960 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.147899    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:20:02.321727 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.321687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbpzj\" (UniqueName: \"kubernetes.io/projected/fdd10436-533f-4f8e-a572-3535def66664-kube-api-access-vbpzj\") pod \"fdd10436-533f-4f8e-a572-3535def66664\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") "
Jul 10 14:20:02.321903 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.321784    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd10436-533f-4f8e-a572-3535def66664-openshift-service-ca\") pod \"fdd10436-533f-4f8e-a572-3535def66664\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") "
Jul 10 14:20:02.321903 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.321814    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls\") pod \"fdd10436-533f-4f8e-a572-3535def66664\" (UID: \"fdd10436-533f-4f8e-a572-3535def66664\") "
Jul 10 14:20:02.322221 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.322180    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd10436-533f-4f8e-a572-3535def66664-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fdd10436-533f-4f8e-a572-3535def66664" (UID: "fdd10436-533f-4f8e-a572-3535def66664"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:20:02.323995 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.323969    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fdd10436-533f-4f8e-a572-3535def66664" (UID: "fdd10436-533f-4f8e-a572-3535def66664"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:20:02.324101 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.323978    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd10436-533f-4f8e-a572-3535def66664-kube-api-access-vbpzj" (OuterVolumeSpecName: "kube-api-access-vbpzj") pod "fdd10436-533f-4f8e-a572-3535def66664" (UID: "fdd10436-533f-4f8e-a572-3535def66664"). InnerVolumeSpecName "kube-api-access-vbpzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:20:02.422617 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.422534    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd10436-533f-4f8e-a572-3535def66664-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:20:02.422617 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.422564    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbpzj\" (UniqueName: \"kubernetes.io/projected/fdd10436-533f-4f8e-a572-3535def66664-kube-api-access-vbpzj\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:20:02.422617 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:02.422575    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd10436-533f-4f8e-a572-3535def66664-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:20:03.102807 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:03.102761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck" event={"ID":"fdd10436-533f-4f8e-a572-3535def66664","Type":"ContainerDied","Data":"d1f05974c251ba9d10b74eab694612fc415f0ae15b563b0eb9d083bd72860e3e"}
Jul 10 14:20:03.103266 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:03.102828    2561 scope.go:117] "RemoveContainer" containerID="20ba47770d8547241e63c7eecdb4f96323898e0b505c09266eba247ea8f22f26"
Jul 10 14:20:03.103266 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:03.102780    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"
Jul 10 14:20:03.125061 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:03.125019    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"]
Jul 10 14:20:03.128659 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:03.128632    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-cce0783f-688d5cb8d4-nb4ck"]
Jul 10 14:20:03.141641 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:20:03.141615    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd10436-533f-4f8e-a572-3535def66664" path="/var/lib/kubelet/pods/fdd10436-533f-4f8e-a572-3535def66664/volumes"
Jul 10 14:22:02.934077 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.934010    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"]
Jul 10 14:22:02.934687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.934560    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd10436-533f-4f8e-a572-3535def66664" containerName="maas-api"
Jul 10 14:22:02.934687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.934580    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd10436-533f-4f8e-a572-3535def66664" containerName="maas-api"
Jul 10 14:22:02.934687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.934685    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd10436-533f-4f8e-a572-3535def66664" containerName="maas-api"
Jul 10 14:22:02.937410 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.937390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:02.950457 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.950432    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:22:02.950457 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.950454    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a6e9e1cb-serving-cert\""
Jul 10 14:22:02.950634 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.950469    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:22:02.951219 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.951205    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:22:02.962102 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:02.962075    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"]
Jul 10 14:22:03.029887 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.029844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4760501a-9cbd-4ca8-b40b-7185c801a02d-openshift-service-ca\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.029887 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.029889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.030150 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.029992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2wc\" (UniqueName: \"kubernetes.io/projected/4760501a-9cbd-4ca8-b40b-7185c801a02d-kube-api-access-xf2wc\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.131085 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.131030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4760501a-9cbd-4ca8-b40b-7185c801a02d-openshift-service-ca\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.131085 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.131088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.131314 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.131123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2wc\" (UniqueName: \"kubernetes.io/projected/4760501a-9cbd-4ca8-b40b-7185c801a02d-kube-api-access-xf2wc\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.131314 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:22:03.131258    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-serving-cert: secret "maas-api-e2e-mt-a6e9e1cb-serving-cert" not found
Jul 10 14:22:03.131408 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:22:03.131325    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls podName:4760501a-9cbd-4ca8-b40b-7185c801a02d nodeName:}" failed. No retries permitted until 2026-07-10 14:22:03.631308061 +0000 UTC m=+1899.015506958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls") pod "maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" (UID: "4760501a-9cbd-4ca8-b40b-7185c801a02d") : secret "maas-api-e2e-mt-a6e9e1cb-serving-cert" not found
Jul 10 14:22:03.131696 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.131675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4760501a-9cbd-4ca8-b40b-7185c801a02d-openshift-service-ca\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.155922 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.155889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2wc\" (UniqueName: \"kubernetes.io/projected/4760501a-9cbd-4ca8-b40b-7185c801a02d-kube-api-access-xf2wc\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.637232 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.637201    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.639760 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.639740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls\") pod \"maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.847391 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.847347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:03.988705 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.988674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"]
Jul 10 14:22:03.992177 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:22:03.992145    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4760501a_9cbd_4ca8_b40b_7185c801a02d.slice/crio-736fa7d6b8998603d6a80eb99d4a7cca952987580725dd74d9808534fbc6cde9 WatchSource:0}: Error finding container 736fa7d6b8998603d6a80eb99d4a7cca952987580725dd74d9808534fbc6cde9: Status 404 returned error can't find the container with id 736fa7d6b8998603d6a80eb99d4a7cca952987580725dd74d9808534fbc6cde9
Jul 10 14:22:03.993521 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:03.993502    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:22:04.641165 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:04.641125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" event={"ID":"4760501a-9cbd-4ca8-b40b-7185c801a02d","Type":"ContainerStarted","Data":"941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5"}
Jul 10 14:22:04.641337 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:04.641188    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" event={"ID":"4760501a-9cbd-4ca8-b40b-7185c801a02d","Type":"ContainerStarted","Data":"736fa7d6b8998603d6a80eb99d4a7cca952987580725dd74d9808534fbc6cde9"}
Jul 10 14:22:04.641337 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:04.641220    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:04.664183 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:04.664131    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" podStartSLOduration=2.110631356 podStartE2EDuration="2.664111883s" totalImagesPullingTime="553.480527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:22:04.662523674 +0000 UTC m=+1900.046722595" watchObservedRunningTime="2026-07-10 14:22:04.664111883 +0000 UTC m=+1900.048310801"
Jul 10 14:22:10.651227 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:10.651195    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:27.005124 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.003249    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"]
Jul 10 14:22:27.005124 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.003594    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" podUID="4760501a-9cbd-4ca8-b40b-7185c801a02d" containerName="maas-api" containerID="cri-o://941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5" gracePeriod=30
Jul 10 14:22:27.256603 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.256541    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:27.359545 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.359514    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4760501a-9cbd-4ca8-b40b-7185c801a02d-openshift-service-ca\") pod \"4760501a-9cbd-4ca8-b40b-7185c801a02d\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") "
Jul 10 14:22:27.359738 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.359553    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf2wc\" (UniqueName: \"kubernetes.io/projected/4760501a-9cbd-4ca8-b40b-7185c801a02d-kube-api-access-xf2wc\") pod \"4760501a-9cbd-4ca8-b40b-7185c801a02d\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") "
Jul 10 14:22:27.359738 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.359604    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls\") pod \"4760501a-9cbd-4ca8-b40b-7185c801a02d\" (UID: \"4760501a-9cbd-4ca8-b40b-7185c801a02d\") "
Jul 10 14:22:27.359876 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.359850    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4760501a-9cbd-4ca8-b40b-7185c801a02d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4760501a-9cbd-4ca8-b40b-7185c801a02d" (UID: "4760501a-9cbd-4ca8-b40b-7185c801a02d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:22:27.361669 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.361644    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4760501a-9cbd-4ca8-b40b-7185c801a02d" (UID: "4760501a-9cbd-4ca8-b40b-7185c801a02d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:22:27.361780 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.361668    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4760501a-9cbd-4ca8-b40b-7185c801a02d-kube-api-access-xf2wc" (OuterVolumeSpecName: "kube-api-access-xf2wc") pod "4760501a-9cbd-4ca8-b40b-7185c801a02d" (UID: "4760501a-9cbd-4ca8-b40b-7185c801a02d"). InnerVolumeSpecName "kube-api-access-xf2wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:22:27.460633 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.460588    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4760501a-9cbd-4ca8-b40b-7185c801a02d-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:22:27.460633 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.460623    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf2wc\" (UniqueName: \"kubernetes.io/projected/4760501a-9cbd-4ca8-b40b-7185c801a02d-kube-api-access-xf2wc\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:22:27.460633 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.460639    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4760501a-9cbd-4ca8-b40b-7185c801a02d-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:22:27.744414 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.744375    2561 generic.go:356] "Generic (PLEG): container finished" podID="4760501a-9cbd-4ca8-b40b-7185c801a02d" containerID="941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5" exitCode=0
Jul 10 14:22:27.744590 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.744426    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"
Jul 10 14:22:27.744590 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.744463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" event={"ID":"4760501a-9cbd-4ca8-b40b-7185c801a02d","Type":"ContainerDied","Data":"941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5"}
Jul 10 14:22:27.744590 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.744522    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m" event={"ID":"4760501a-9cbd-4ca8-b40b-7185c801a02d","Type":"ContainerDied","Data":"736fa7d6b8998603d6a80eb99d4a7cca952987580725dd74d9808534fbc6cde9"}
Jul 10 14:22:27.744590 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.744547    2561 scope.go:117] "RemoveContainer" containerID="941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5"
Jul 10 14:22:27.756535 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.756517    2561 scope.go:117] "RemoveContainer" containerID="941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5"
Jul 10 14:22:27.756802 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:22:27.756778    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5\": container with ID starting with 941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5 not found: ID does not exist" containerID="941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5"
Jul 10 14:22:27.756902 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.756811    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5"} err="failed to get container status \"941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5\": rpc error: code = NotFound desc = could not find container \"941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5\": container with ID starting with 941dc64c8b18caffaaa6ec85d48384d1522b3addaa4e00945c830b992f2729e5 not found: ID does not exist"
Jul 10 14:22:27.772695 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.772662    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"]
Jul 10 14:22:27.777861 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:27.777834    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a6e9e1cb-859f6fb68c-qjt8m"]
Jul 10 14:22:29.141793 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:22:29.141760    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4760501a-9cbd-4ca8-b40b-7185c801a02d" path="/var/lib/kubelet/pods/4760501a-9cbd-4ca8-b40b-7185c801a02d/volumes"
Jul 10 14:23:06.128377 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.128335    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"]
Jul 10 14:23:06.128952 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.128850    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4760501a-9cbd-4ca8-b40b-7185c801a02d" containerName="maas-api"
Jul 10 14:23:06.128952 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.128870    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4760501a-9cbd-4ca8-b40b-7185c801a02d" containerName="maas-api"
Jul 10 14:23:06.129142 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.128983    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4760501a-9cbd-4ca8-b40b-7185c801a02d" containerName="maas-api"
Jul 10 14:23:06.138650 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.138620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.141281 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.141235    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0c74fa54-serving-cert\""
Jul 10 14:23:06.141281 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.141264    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:23:06.142236 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.142217    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:23:06.142467 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.142443    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:23:06.148099 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.148073    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"]
Jul 10 14:23:06.305568 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.305526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334b317b-ee15-42d2-8ce3-6222ed5521c1-openshift-service-ca\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.305751 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.305627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.305751 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.305704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6cgb\" (UniqueName: \"kubernetes.io/projected/334b317b-ee15-42d2-8ce3-6222ed5521c1-kube-api-access-w6cgb\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.407040 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.406945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6cgb\" (UniqueName: \"kubernetes.io/projected/334b317b-ee15-42d2-8ce3-6222ed5521c1-kube-api-access-w6cgb\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.407040 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.407012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334b317b-ee15-42d2-8ce3-6222ed5521c1-openshift-service-ca\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.407275 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.407088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.407275 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:23:06.407186    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-serving-cert: secret "maas-api-e2e-mt-0c74fa54-serving-cert" not found
Jul 10 14:23:06.407275 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:23:06.407246    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls podName:334b317b-ee15-42d2-8ce3-6222ed5521c1 nodeName:}" failed. No retries permitted until 2026-07-10 14:23:06.907223391 +0000 UTC m=+1962.291422289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls") pod "maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" (UID: "334b317b-ee15-42d2-8ce3-6222ed5521c1") : secret "maas-api-e2e-mt-0c74fa54-serving-cert" not found
Jul 10 14:23:06.407683 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.407662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334b317b-ee15-42d2-8ce3-6222ed5521c1-openshift-service-ca\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.423008 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.422978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6cgb\" (UniqueName: \"kubernetes.io/projected/334b317b-ee15-42d2-8ce3-6222ed5521c1-kube-api-access-w6cgb\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.912525 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.912482    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:06.914975 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:06.914948    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls\") pod \"maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:07.051308 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:07.051260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:07.187707 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:07.187638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"]
Jul 10 14:23:07.190093 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:23:07.190042    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334b317b_ee15_42d2_8ce3_6222ed5521c1.slice/crio-9b15452a59b2bdb6c2018d6e823797937efdef6a8d91bc780116c3aff0cb606d WatchSource:0}: Error finding container 9b15452a59b2bdb6c2018d6e823797937efdef6a8d91bc780116c3aff0cb606d: Status 404 returned error can't find the container with id 9b15452a59b2bdb6c2018d6e823797937efdef6a8d91bc780116c3aff0cb606d
Jul 10 14:23:07.922512 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:07.922421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" event={"ID":"334b317b-ee15-42d2-8ce3-6222ed5521c1","Type":"ContainerStarted","Data":"746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f"}
Jul 10 14:23:07.922512 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:07.922474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" event={"ID":"334b317b-ee15-42d2-8ce3-6222ed5521c1","Type":"ContainerStarted","Data":"9b15452a59b2bdb6c2018d6e823797937efdef6a8d91bc780116c3aff0cb606d"}
Jul 10 14:23:07.922703 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:07.922545    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:07.941405 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:07.941265    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" podStartSLOduration=1.470751841 podStartE2EDuration="1.941238369s" totalImagesPullingTime="470.486528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:23:07.941028556 +0000 UTC m=+1963.325227475" watchObservedRunningTime="2026-07-10 14:23:07.941238369 +0000 UTC m=+1963.325437376"
Jul 10 14:23:13.933387 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:13.933359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:49.048438 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.048404    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"]
Jul 10 14:23:49.049066 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.048604    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" podUID="334b317b-ee15-42d2-8ce3-6222ed5521c1" containerName="maas-api" containerID="cri-o://746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f" gracePeriod=30
Jul 10 14:23:49.296702 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.296677    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:49.298136 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.298117    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334b317b-ee15-42d2-8ce3-6222ed5521c1-openshift-service-ca\") pod \"334b317b-ee15-42d2-8ce3-6222ed5521c1\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") "
Jul 10 14:23:49.298196 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.298159    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6cgb\" (UniqueName: \"kubernetes.io/projected/334b317b-ee15-42d2-8ce3-6222ed5521c1-kube-api-access-w6cgb\") pod \"334b317b-ee15-42d2-8ce3-6222ed5521c1\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") "
Jul 10 14:23:49.298231 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.298210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls\") pod \"334b317b-ee15-42d2-8ce3-6222ed5521c1\" (UID: \"334b317b-ee15-42d2-8ce3-6222ed5521c1\") "
Jul 10 14:23:49.298555 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.298494    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/334b317b-ee15-42d2-8ce3-6222ed5521c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "334b317b-ee15-42d2-8ce3-6222ed5521c1" (UID: "334b317b-ee15-42d2-8ce3-6222ed5521c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:23:49.300275 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.300253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "334b317b-ee15-42d2-8ce3-6222ed5521c1" (UID: "334b317b-ee15-42d2-8ce3-6222ed5521c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:23:49.300343 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.300304    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/334b317b-ee15-42d2-8ce3-6222ed5521c1-kube-api-access-w6cgb" (OuterVolumeSpecName: "kube-api-access-w6cgb") pod "334b317b-ee15-42d2-8ce3-6222ed5521c1" (UID: "334b317b-ee15-42d2-8ce3-6222ed5521c1"). InnerVolumeSpecName "kube-api-access-w6cgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:23:49.399271 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.399233    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/334b317b-ee15-42d2-8ce3-6222ed5521c1-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:23:49.399271 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.399268    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/334b317b-ee15-42d2-8ce3-6222ed5521c1-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:23:49.399271 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:49.399278    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6cgb\" (UniqueName: \"kubernetes.io/projected/334b317b-ee15-42d2-8ce3-6222ed5521c1-kube-api-access-w6cgb\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:23:50.108697 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.108660    2561 generic.go:356] "Generic (PLEG): container finished" podID="334b317b-ee15-42d2-8ce3-6222ed5521c1" containerID="746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f" exitCode=0
Jul 10 14:23:50.109105 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.108709    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"
Jul 10 14:23:50.109105 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.108713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" event={"ID":"334b317b-ee15-42d2-8ce3-6222ed5521c1","Type":"ContainerDied","Data":"746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f"}
Jul 10 14:23:50.109105 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.108768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4" event={"ID":"334b317b-ee15-42d2-8ce3-6222ed5521c1","Type":"ContainerDied","Data":"9b15452a59b2bdb6c2018d6e823797937efdef6a8d91bc780116c3aff0cb606d"}
Jul 10 14:23:50.109105 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.108799    2561 scope.go:117] "RemoveContainer" containerID="746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f"
Jul 10 14:23:50.117501 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.117466    2561 scope.go:117] "RemoveContainer" containerID="746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f"
Jul 10 14:23:50.117783 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:23:50.117759    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f\": container with ID starting with 746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f not found: ID does not exist" containerID="746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f"
Jul 10 14:23:50.117859 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.117791    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f"} err="failed to get container status \"746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f\": rpc error: code = NotFound desc = could not find container \"746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f\": container with ID starting with 746a300cbbf47fccf0abbb126709c3f6c8fee5f9328cff7ae88d93d84b626a9f not found: ID does not exist"
Jul 10 14:23:50.146326 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.146294    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"]
Jul 10 14:23:50.155285 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:50.155261    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0c74fa54-75c65bb7b7-dxqt4"]
Jul 10 14:23:51.141916 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:23:51.141876    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="334b317b-ee15-42d2-8ce3-6222ed5521c1" path="/var/lib/kubelet/pods/334b317b-ee15-42d2-8ce3-6222ed5521c1/volumes"
Jul 10 14:25:57.110110 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.110077    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"]
Jul 10 14:25:57.110635 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.110462    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="334b317b-ee15-42d2-8ce3-6222ed5521c1" containerName="maas-api"
Jul 10 14:25:57.110635 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.110474    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="334b317b-ee15-42d2-8ce3-6222ed5521c1" containerName="maas-api"
Jul 10 14:25:57.110635 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.110537    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="334b317b-ee15-42d2-8ce3-6222ed5521c1" containerName="maas-api"
Jul 10 14:25:57.113251 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.113230    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.115863 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.115841    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:25:57.115989 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.115841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:25:57.115989 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.115841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ee9f0f-serving-cert\""
Jul 10 14:25:57.116728 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.116710    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:25:57.122939 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.122916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"]
Jul 10 14:25:57.256356 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.256322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-maas-api-tls\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.256536 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.256366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.256536 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.256389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvd57\" (UniqueName: \"kubernetes.io/projected/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-kube-api-access-wvd57\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.357880 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.357844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.357880 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.357885    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvd57\" (UniqueName: \"kubernetes.io/projected/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-kube-api-access-wvd57\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.358130 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.358006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-maas-api-tls\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.358669 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.358644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.360472 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.360414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-maas-api-tls\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.366966 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.366942    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvd57\" (UniqueName: \"kubernetes.io/projected/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-kube-api-access-wvd57\") pod \"maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.424928 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.424892    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:57.565853 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.565827    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"]
Jul 10 14:25:57.568408 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:25:57.568376    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e870182_0521_4ec4_b0aa_0ccaa278f4fc.slice/crio-55dfdfd0c7e7d8ed1e304acfccf707a8d447294fdfb2daff8925d2f317d06e40 WatchSource:0}: Error finding container 55dfdfd0c7e7d8ed1e304acfccf707a8d447294fdfb2daff8925d2f317d06e40: Status 404 returned error can't find the container with id 55dfdfd0c7e7d8ed1e304acfccf707a8d447294fdfb2daff8925d2f317d06e40
Jul 10 14:25:57.681135 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:57.681025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g" event={"ID":"1e870182-0521-4ec4-b0aa-0ccaa278f4fc","Type":"ContainerStarted","Data":"55dfdfd0c7e7d8ed1e304acfccf707a8d447294fdfb2daff8925d2f317d06e40"}
Jul 10 14:25:58.695722 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:58.695681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g" event={"ID":"1e870182-0521-4ec4-b0aa-0ccaa278f4fc","Type":"ContainerStarted","Data":"bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26"}
Jul 10 14:25:58.696195 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:58.695860    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:25:58.719388 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:25:58.719339    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g" podStartSLOduration=1.336047533 podStartE2EDuration="1.719322979s" totalImagesPullingTime="383.275446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:25:58.717903458 +0000 UTC m=+2134.102102377" watchObservedRunningTime="2026-07-10 14:25:58.719322979 +0000 UTC m=+2134.103521899"
Jul 10 14:26:04.705192 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:04.705163    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:26:05.182924 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.182892    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"]
Jul 10 14:26:05.186432 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.186413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.188958 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.188938    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e3d9d1-serving-cert\""
Jul 10 14:26:05.203120 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.203096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"]
Jul 10 14:26:05.237366 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.237333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdcsk\" (UniqueName: \"kubernetes.io/projected/f20f51c9-d72f-498a-bef7-b5cd2b08527f-kube-api-access-jdcsk\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.237526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.237380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.237526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.237404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20f51c9-d72f-498a-bef7-b5cd2b08527f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.338767 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.338729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdcsk\" (UniqueName: \"kubernetes.io/projected/f20f51c9-d72f-498a-bef7-b5cd2b08527f-kube-api-access-jdcsk\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.338963 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.338787    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.338963 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.338820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20f51c9-d72f-498a-bef7-b5cd2b08527f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.339127 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:26:05.338971    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-serving-cert: secret "maas-api-e2e-inf-b-e3d9d1-serving-cert" not found
Jul 10 14:26:05.339127 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:26:05.339044    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls podName:f20f51c9-d72f-498a-bef7-b5cd2b08527f nodeName:}" failed. No retries permitted until 2026-07-10 14:26:05.839022874 +0000 UTC m=+2141.223221776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls") pod "maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" (UID: "f20f51c9-d72f-498a-bef7-b5cd2b08527f") : secret "maas-api-e2e-inf-b-e3d9d1-serving-cert" not found
Jul 10 14:26:05.339571 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.339552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20f51c9-d72f-498a-bef7-b5cd2b08527f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.349598 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.349563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdcsk\" (UniqueName: \"kubernetes.io/projected/f20f51c9-d72f-498a-bef7-b5cd2b08527f-kube-api-access-jdcsk\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.843043 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.843004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:05.845623 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:05.845597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls\") pod \"maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:06.097488 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:06.097391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:06.234201 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:06.234168    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"]
Jul 10 14:26:06.237224 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:26:06.237198    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20f51c9_d72f_498a_bef7_b5cd2b08527f.slice/crio-ca74443c099a8e1533eda1e34017ef21584c2aec55a0ce65331da8bf72bab64d WatchSource:0}: Error finding container ca74443c099a8e1533eda1e34017ef21584c2aec55a0ce65331da8bf72bab64d: Status 404 returned error can't find the container with id ca74443c099a8e1533eda1e34017ef21584c2aec55a0ce65331da8bf72bab64d
Jul 10 14:26:06.732954 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:06.732923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" event={"ID":"f20f51c9-d72f-498a-bef7-b5cd2b08527f","Type":"ContainerStarted","Data":"ca74443c099a8e1533eda1e34017ef21584c2aec55a0ce65331da8bf72bab64d"}
Jul 10 14:26:07.738323 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:07.738287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" event={"ID":"f20f51c9-d72f-498a-bef7-b5cd2b08527f","Type":"ContainerStarted","Data":"ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4"}
Jul 10 14:26:07.738778 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:07.738368    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:26:07.760287 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:07.760237    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" podStartSLOduration=2.291176086 podStartE2EDuration="2.760216609s" totalImagesPullingTime="469.040523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:26:07.758666824 +0000 UTC m=+2143.142865737" watchObservedRunningTime="2026-07-10 14:26:07.760216609 +0000 UTC m=+2143.144415528"
Jul 10 14:26:13.748523 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:26:13.748492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:27:26.738230 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:26.738190    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"]
Jul 10 14:27:26.738782 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:26.738558    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g" podUID="1e870182-0521-4ec4-b0aa-0ccaa278f4fc" containerName="maas-api" containerID="cri-o://bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26" gracePeriod=30
Jul 10 14:27:26.995002 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:26.994934    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:27:27.091640 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.091600    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-openshift-service-ca\") pod \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") "
Jul 10 14:27:27.091817 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.091713    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-maas-api-tls\") pod \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") "
Jul 10 14:27:27.091817 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.091755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvd57\" (UniqueName: \"kubernetes.io/projected/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-kube-api-access-wvd57\") pod \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\" (UID: \"1e870182-0521-4ec4-b0aa-0ccaa278f4fc\") "
Jul 10 14:27:27.091996 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.091971    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e870182-0521-4ec4-b0aa-0ccaa278f4fc" (UID: "1e870182-0521-4ec4-b0aa-0ccaa278f4fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:27:27.093886 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.093854    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e870182-0521-4ec4-b0aa-0ccaa278f4fc" (UID: "1e870182-0521-4ec4-b0aa-0ccaa278f4fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:27:27.093886 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.093859    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-kube-api-access-wvd57" (OuterVolumeSpecName: "kube-api-access-wvd57") pod "1e870182-0521-4ec4-b0aa-0ccaa278f4fc" (UID: "1e870182-0521-4ec4-b0aa-0ccaa278f4fc"). InnerVolumeSpecName "kube-api-access-wvd57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:27:27.112863 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.112833    2561 generic.go:356] "Generic (PLEG): container finished" podID="1e870182-0521-4ec4-b0aa-0ccaa278f4fc" containerID="bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26" exitCode=0
Jul 10 14:27:27.113010 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.112883    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"
Jul 10 14:27:27.113010 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.112909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g" event={"ID":"1e870182-0521-4ec4-b0aa-0ccaa278f4fc","Type":"ContainerDied","Data":"bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26"}
Jul 10 14:27:27.113010 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.112961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g" event={"ID":"1e870182-0521-4ec4-b0aa-0ccaa278f4fc","Type":"ContainerDied","Data":"55dfdfd0c7e7d8ed1e304acfccf707a8d447294fdfb2daff8925d2f317d06e40"}
Jul 10 14:27:27.113010 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.112986    2561 scope.go:117] "RemoveContainer" containerID="bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26"
Jul 10 14:27:27.121859 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.121843    2561 scope.go:117] "RemoveContainer" containerID="bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26"
Jul 10 14:27:27.122174 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:27:27.122146    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26\": container with ID starting with bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26 not found: ID does not exist" containerID="bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26"
Jul 10 14:27:27.122269 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.122182    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26"} err="failed to get container status \"bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26\": rpc error: code = NotFound desc = could not find container \"bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26\": container with ID starting with bea41037c2141e6328bbcd684bd8fc921995cd602eaab9a627e040d759a20a26 not found: ID does not exist"
Jul 10 14:27:27.143348 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.143322    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"]
Jul 10 14:27:27.147646 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.147624    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ee9f0f-5df749854-z5x8g"]
Jul 10 14:27:27.193007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.192969    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:27:27.193007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.192998    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:27:27.193007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:27.193012    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvd57\" (UniqueName: \"kubernetes.io/projected/1e870182-0521-4ec4-b0aa-0ccaa278f4fc-kube-api-access-wvd57\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:27:29.141556 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:29.141524    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e870182-0521-4ec4-b0aa-0ccaa278f4fc" path="/var/lib/kubelet/pods/1e870182-0521-4ec4-b0aa-0ccaa278f4fc/volumes"
Jul 10 14:27:52.935456 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:52.935371    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"]
Jul 10 14:27:52.935987 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:52.935568    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" podUID="f20f51c9-d72f-498a-bef7-b5cd2b08527f" containerName="maas-api" containerID="cri-o://ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4" gracePeriod=30
Jul 10 14:27:53.178786 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.178763    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:27:53.234276 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.234185    2561 generic.go:356] "Generic (PLEG): container finished" podID="f20f51c9-d72f-498a-bef7-b5cd2b08527f" containerID="ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4" exitCode=0
Jul 10 14:27:53.234276 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.234227    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"
Jul 10 14:27:53.234276 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.234259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" event={"ID":"f20f51c9-d72f-498a-bef7-b5cd2b08527f","Type":"ContainerDied","Data":"ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4"}
Jul 10 14:27:53.234526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.234312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52" event={"ID":"f20f51c9-d72f-498a-bef7-b5cd2b08527f","Type":"ContainerDied","Data":"ca74443c099a8e1533eda1e34017ef21584c2aec55a0ce65331da8bf72bab64d"}
Jul 10 14:27:53.234526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.234335    2561 scope.go:117] "RemoveContainer" containerID="ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4"
Jul 10 14:27:53.242250 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.242234    2561 scope.go:117] "RemoveContainer" containerID="ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4"
Jul 10 14:27:53.242489 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:27:53.242472    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4\": container with ID starting with ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4 not found: ID does not exist" containerID="ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4"
Jul 10 14:27:53.242542 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.242498    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4"} err="failed to get container status \"ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4\": rpc error: code = NotFound desc = could not find container \"ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4\": container with ID starting with ec20ba6246ee56ba3c7421ba2b2b4e543dfe9727d41b4e2471482ba1c1ab0ee4 not found: ID does not exist"
Jul 10 14:27:53.313874 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.313845    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls\") pod \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") "
Jul 10 14:27:53.314093 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.313891    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdcsk\" (UniqueName: \"kubernetes.io/projected/f20f51c9-d72f-498a-bef7-b5cd2b08527f-kube-api-access-jdcsk\") pod \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") "
Jul 10 14:27:53.314093 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.313925    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20f51c9-d72f-498a-bef7-b5cd2b08527f-openshift-service-ca\") pod \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\" (UID: \"f20f51c9-d72f-498a-bef7-b5cd2b08527f\") "
Jul 10 14:27:53.314407 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.314377    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f20f51c9-d72f-498a-bef7-b5cd2b08527f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f20f51c9-d72f-498a-bef7-b5cd2b08527f" (UID: "f20f51c9-d72f-498a-bef7-b5cd2b08527f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:27:53.316044 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.316015    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f20f51c9-d72f-498a-bef7-b5cd2b08527f" (UID: "f20f51c9-d72f-498a-bef7-b5cd2b08527f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:27:53.316044 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.316029    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f20f51c9-d72f-498a-bef7-b5cd2b08527f-kube-api-access-jdcsk" (OuterVolumeSpecName: "kube-api-access-jdcsk") pod "f20f51c9-d72f-498a-bef7-b5cd2b08527f" (UID: "f20f51c9-d72f-498a-bef7-b5cd2b08527f"). InnerVolumeSpecName "kube-api-access-jdcsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:27:53.415317 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.415284    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f20f51c9-d72f-498a-bef7-b5cd2b08527f-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:27:53.415317 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.415312    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdcsk\" (UniqueName: \"kubernetes.io/projected/f20f51c9-d72f-498a-bef7-b5cd2b08527f-kube-api-access-jdcsk\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:27:53.415317 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.415323    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f20f51c9-d72f-498a-bef7-b5cd2b08527f-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:27:53.583998 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.581100    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"]
Jul 10 14:27:53.587386 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:53.587356    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e3d9d1-599688f8f4-9qv52"]
Jul 10 14:27:55.141217 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:27:55.141184    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f20f51c9-d72f-498a-bef7-b5cd2b08527f" path="/var/lib/kubelet/pods/f20f51c9-d72f-498a-bef7-b5cd2b08527f/volumes"
Jul 10 14:28:13.366527 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366495    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"]
Jul 10 14:28:13.366895 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366838    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f20f51c9-d72f-498a-bef7-b5cd2b08527f" containerName="maas-api"
Jul 10 14:28:13.366895 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366850    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f20f51c9-d72f-498a-bef7-b5cd2b08527f" containerName="maas-api"
Jul 10 14:28:13.366895 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366867    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e870182-0521-4ec4-b0aa-0ccaa278f4fc" containerName="maas-api"
Jul 10 14:28:13.366895 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366872    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e870182-0521-4ec4-b0aa-0ccaa278f4fc" containerName="maas-api"
Jul 10 14:28:13.367022 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366924    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e870182-0521-4ec4-b0aa-0ccaa278f4fc" containerName="maas-api"
Jul 10 14:28:13.367022 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.366934    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f20f51c9-d72f-498a-bef7-b5cd2b08527f" containerName="maas-api"
Jul 10 14:28:13.369973 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.369958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.377768 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.377744    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7beb38-serving-cert\""
Jul 10 14:28:13.377902 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.377773    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:28:13.378739 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.378719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:28:13.382773 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.382752    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:28:13.426309 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.426275    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"]
Jul 10 14:28:13.497955 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.497917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll8tj\" (UniqueName: \"kubernetes.io/projected/0b314e87-efd1-4eb1-a316-137b3eb50d80-kube-api-access-ll8tj\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.498147 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.497969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b314e87-efd1-4eb1-a316-137b3eb50d80-maas-api-tls\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.498147 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.498095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b314e87-efd1-4eb1-a316-137b3eb50d80-openshift-service-ca\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.598898 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.598860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll8tj\" (UniqueName: \"kubernetes.io/projected/0b314e87-efd1-4eb1-a316-137b3eb50d80-kube-api-access-ll8tj\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.599124 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.598914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b314e87-efd1-4eb1-a316-137b3eb50d80-maas-api-tls\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.599124 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.598951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b314e87-efd1-4eb1-a316-137b3eb50d80-openshift-service-ca\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.599614 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.599596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b314e87-efd1-4eb1-a316-137b3eb50d80-openshift-service-ca\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.601374 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.601354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b314e87-efd1-4eb1-a316-137b3eb50d80-maas-api-tls\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.614731 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.614709    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll8tj\" (UniqueName: \"kubernetes.io/projected/0b314e87-efd1-4eb1-a316-137b3eb50d80-kube-api-access-ll8tj\") pod \"maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.680459 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.680359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:13.835953 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.835928    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"]
Jul 10 14:28:13.837347 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:28:13.837320    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b314e87_efd1_4eb1_a316_137b3eb50d80.slice/crio-3381abdf905ec019a8733509abbf804fac480d5d73be3cc492ab0121bce27170 WatchSource:0}: Error finding container 3381abdf905ec019a8733509abbf804fac480d5d73be3cc492ab0121bce27170: Status 404 returned error can't find the container with id 3381abdf905ec019a8733509abbf804fac480d5d73be3cc492ab0121bce27170
Jul 10 14:28:13.839074 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:13.839035    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:28:14.332972 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:14.332942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk" event={"ID":"0b314e87-efd1-4eb1-a316-137b3eb50d80","Type":"ContainerStarted","Data":"3381abdf905ec019a8733509abbf804fac480d5d73be3cc492ab0121bce27170"}
Jul 10 14:28:15.340008 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:15.339967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk" event={"ID":"0b314e87-efd1-4eb1-a316-137b3eb50d80","Type":"ContainerStarted","Data":"37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af"}
Jul 10 14:28:15.340412 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:15.340116    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:15.387063 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:15.387002    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk" podStartSLOduration=1.862765153 podStartE2EDuration="2.386987034s" totalImagesPullingTime="524.221881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:28:15.385464092 +0000 UTC m=+2270.769663013" watchObservedRunningTime="2026-07-10 14:28:15.386987034 +0000 UTC m=+2270.771185952"
Jul 10 14:28:21.351322 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:21.351291    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:22.065748 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.065708    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"]
Jul 10 14:28:22.069405 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.069388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.071817 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.071788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.071931 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.071814    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b5750f-serving-cert\""
Jul 10 14:28:22.071931 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.071862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n488\" (UniqueName: \"kubernetes.io/projected/f8511308-26f1-4454-a858-3a65eb9e5bdd-kube-api-access-5n488\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.071931 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.071889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8511308-26f1-4454-a858-3a65eb9e5bdd-openshift-service-ca\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.083876 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.083850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"]
Jul 10 14:28:22.172395 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.172360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n488\" (UniqueName: \"kubernetes.io/projected/f8511308-26f1-4454-a858-3a65eb9e5bdd-kube-api-access-5n488\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.172395 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.172407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8511308-26f1-4454-a858-3a65eb9e5bdd-openshift-service-ca\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.172647 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.172575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.172739 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:28:22.172718    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-serving-cert: secret "maas-api-e2e-api-b-b5750f-serving-cert" not found
Jul 10 14:28:22.172808 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:28:22.172798    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls podName:f8511308-26f1-4454-a858-3a65eb9e5bdd nodeName:}" failed. No retries permitted until 2026-07-10 14:28:22.672780158 +0000 UTC m=+2278.056979056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls") pod "maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" (UID: "f8511308-26f1-4454-a858-3a65eb9e5bdd") : secret "maas-api-e2e-api-b-b5750f-serving-cert" not found
Jul 10 14:28:22.173084 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.173066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8511308-26f1-4454-a858-3a65eb9e5bdd-openshift-service-ca\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.183860 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.183834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n488\" (UniqueName: \"kubernetes.io/projected/f8511308-26f1-4454-a858-3a65eb9e5bdd-kube-api-access-5n488\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.677201 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.677164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.679642 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.679620    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls\") pod \"maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:22.979755 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:22.979654    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:23.126522 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:23.126459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"]
Jul 10 14:28:23.129198 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:28:23.129164    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8511308_26f1_4454_a858_3a65eb9e5bdd.slice/crio-9e1677c0b367d57619a19559ed2e27df4f99b557cf3e5128193288650b94c0bf WatchSource:0}: Error finding container 9e1677c0b367d57619a19559ed2e27df4f99b557cf3e5128193288650b94c0bf: Status 404 returned error can't find the container with id 9e1677c0b367d57619a19559ed2e27df4f99b557cf3e5128193288650b94c0bf
Jul 10 14:28:23.379851 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:23.379816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" event={"ID":"f8511308-26f1-4454-a858-3a65eb9e5bdd","Type":"ContainerStarted","Data":"9e1677c0b367d57619a19559ed2e27df4f99b557cf3e5128193288650b94c0bf"}
Jul 10 14:28:24.386402 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:24.386366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" event={"ID":"f8511308-26f1-4454-a858-3a65eb9e5bdd","Type":"ContainerStarted","Data":"d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f"}
Jul 10 14:28:24.386992 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:24.386498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:24.416748 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:24.416690    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" podStartSLOduration=2.124587638 podStartE2EDuration="2.41667312s" totalImagesPullingTime="292.085482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:28:24.415401259 +0000 UTC m=+2279.799600178" watchObservedRunningTime="2026-07-10 14:28:24.41667312 +0000 UTC m=+2279.800872039"
Jul 10 14:28:30.396794 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:30.396766    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:28:44.597889 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.597854    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"]
Jul 10 14:28:44.598404 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.598058    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk" podUID="0b314e87-efd1-4eb1-a316-137b3eb50d80" containerName="maas-api" containerID="cri-o://37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af" gracePeriod=30
Jul 10 14:28:44.848334 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.848263    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:44.989135 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.989095    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll8tj\" (UniqueName: \"kubernetes.io/projected/0b314e87-efd1-4eb1-a316-137b3eb50d80-kube-api-access-ll8tj\") pod \"0b314e87-efd1-4eb1-a316-137b3eb50d80\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") "
Jul 10 14:28:44.989314 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.989183    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b314e87-efd1-4eb1-a316-137b3eb50d80-openshift-service-ca\") pod \"0b314e87-efd1-4eb1-a316-137b3eb50d80\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") "
Jul 10 14:28:44.989314 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.989280    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b314e87-efd1-4eb1-a316-137b3eb50d80-maas-api-tls\") pod \"0b314e87-efd1-4eb1-a316-137b3eb50d80\" (UID: \"0b314e87-efd1-4eb1-a316-137b3eb50d80\") "
Jul 10 14:28:44.989556 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.989534    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b314e87-efd1-4eb1-a316-137b3eb50d80-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b314e87-efd1-4eb1-a316-137b3eb50d80" (UID: "0b314e87-efd1-4eb1-a316-137b3eb50d80"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:28:44.991324 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.991304    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b314e87-efd1-4eb1-a316-137b3eb50d80-kube-api-access-ll8tj" (OuterVolumeSpecName: "kube-api-access-ll8tj") pod "0b314e87-efd1-4eb1-a316-137b3eb50d80" (UID: "0b314e87-efd1-4eb1-a316-137b3eb50d80"). InnerVolumeSpecName "kube-api-access-ll8tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:28:44.991454 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:44.991434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b314e87-efd1-4eb1-a316-137b3eb50d80-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b314e87-efd1-4eb1-a316-137b3eb50d80" (UID: "0b314e87-efd1-4eb1-a316-137b3eb50d80"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:28:45.090888 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.090854    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll8tj\" (UniqueName: \"kubernetes.io/projected/0b314e87-efd1-4eb1-a316-137b3eb50d80-kube-api-access-ll8tj\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:28:45.090888 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.090883    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b314e87-efd1-4eb1-a316-137b3eb50d80-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:28:45.090888 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.090894    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b314e87-efd1-4eb1-a316-137b3eb50d80-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:28:45.482526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.482432    2561 generic.go:356] "Generic (PLEG): container finished" podID="0b314e87-efd1-4eb1-a316-137b3eb50d80" containerID="37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af" exitCode=0
Jul 10 14:28:45.482526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.482473    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"
Jul 10 14:28:45.482526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.482506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk" event={"ID":"0b314e87-efd1-4eb1-a316-137b3eb50d80","Type":"ContainerDied","Data":"37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af"}
Jul 10 14:28:45.482759 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.482554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk" event={"ID":"0b314e87-efd1-4eb1-a316-137b3eb50d80","Type":"ContainerDied","Data":"3381abdf905ec019a8733509abbf804fac480d5d73be3cc492ab0121bce27170"}
Jul 10 14:28:45.482759 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.482578    2561 scope.go:117] "RemoveContainer" containerID="37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af"
Jul 10 14:28:45.490687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.490667    2561 scope.go:117] "RemoveContainer" containerID="37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af"
Jul 10 14:28:45.490973 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:28:45.490953    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af\": container with ID starting with 37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af not found: ID does not exist" containerID="37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af"
Jul 10 14:28:45.491065 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.490979    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af"} err="failed to get container status \"37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af\": rpc error: code = NotFound desc = could not find container \"37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af\": container with ID starting with 37f1d97e194e2f8f82050654e70a7241ef5e14d23d1a41e01820f8cd56f5e1af not found: ID does not exist"
Jul 10 14:28:45.500917 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.500891    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"]
Jul 10 14:28:45.504964 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:45.504941    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7beb38-6675bdb847-qsqsk"]
Jul 10 14:28:47.142322 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:28:47.142287    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b314e87-efd1-4eb1-a316-137b3eb50d80" path="/var/lib/kubelet/pods/0b314e87-efd1-4eb1-a316-137b3eb50d80/volumes"
Jul 10 14:29:00.485687 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.485647    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"]
Jul 10 14:29:00.486112 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.486018    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b314e87-efd1-4eb1-a316-137b3eb50d80" containerName="maas-api"
Jul 10 14:29:00.486112 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.486029    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b314e87-efd1-4eb1-a316-137b3eb50d80" containerName="maas-api"
Jul 10 14:29:00.486112 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.486106    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b314e87-efd1-4eb1-a316-137b3eb50d80" containerName="maas-api"
Jul 10 14:29:00.490431 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.490404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:00.494299 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.494274    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qd8l\""
Jul 10 14:29:00.502520 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.502489    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"]
Jul 10 14:29:00.529882 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.529847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78008fcb-6f8d-45a6-a31f-854a5f69bcde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz\" (UID: \"78008fcb-6f8d-45a6-a31f-854a5f69bcde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:00.630599 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.630562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78008fcb-6f8d-45a6-a31f-854a5f69bcde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz\" (UID: \"78008fcb-6f8d-45a6-a31f-854a5f69bcde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:00.631228 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.631207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78008fcb-6f8d-45a6-a31f-854a5f69bcde-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz\" (UID: \"78008fcb-6f8d-45a6-a31f-854a5f69bcde\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:00.800018 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.799906    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:00.964685 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:00.964657    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"]
Jul 10 14:29:00.965218 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:29:00.965186    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78008fcb_6f8d_45a6_a31f_854a5f69bcde.slice/crio-bbb846a207e1043f1d250f0b632706b56387ee673eea6266864d0757805cd488 WatchSource:0}: Error finding container bbb846a207e1043f1d250f0b632706b56387ee673eea6266864d0757805cd488: Status 404 returned error can't find the container with id bbb846a207e1043f1d250f0b632706b56387ee673eea6266864d0757805cd488
Jul 10 14:29:01.554321 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:01.554288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz" event={"ID":"78008fcb-6f8d-45a6-a31f-854a5f69bcde","Type":"ContainerStarted","Data":"bbb846a207e1043f1d250f0b632706b56387ee673eea6266864d0757805cd488"}
Jul 10 14:29:03.566115 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:03.566079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz" event={"ID":"78008fcb-6f8d-45a6-a31f-854a5f69bcde","Type":"ContainerStarted","Data":"da311a6efed51cf79acf332241334b752f88d6a0cf7423564c9745614d0b1ad0"}
Jul 10 14:29:03.596745 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:03.596688    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz" podStartSLOduration=1.591922235 podStartE2EDuration="3.596668673s" totalImagesPullingTime="2.004746438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:29:03.596195384 +0000 UTC m=+2318.980394302" watchObservedRunningTime="2026-07-10 14:29:03.596668673 +0000 UTC m=+2318.980867594"
Jul 10 14:29:04.572291 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:04.572254    2561 generic.go:356] "Generic (PLEG): container finished" podID="78008fcb-6f8d-45a6-a31f-854a5f69bcde" containerID="da311a6efed51cf79acf332241334b752f88d6a0cf7423564c9745614d0b1ad0" exitCode=0
Jul 10 14:29:04.572699 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:04.572294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz" event={"ID":"78008fcb-6f8d-45a6-a31f-854a5f69bcde","Type":"ContainerDied","Data":"da311a6efed51cf79acf332241334b752f88d6a0cf7423564c9745614d0b1ad0"}
Jul 10 14:29:05.705426 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:05.705398    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:05.777843 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:05.777808    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78008fcb-6f8d-45a6-a31f-854a5f69bcde-maas-api-service-ca\") pod \"78008fcb-6f8d-45a6-a31f-854a5f69bcde\" (UID: \"78008fcb-6f8d-45a6-a31f-854a5f69bcde\") "
Jul 10 14:29:05.778212 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:05.778189    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78008fcb-6f8d-45a6-a31f-854a5f69bcde-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78008fcb-6f8d-45a6-a31f-854a5f69bcde" (UID: "78008fcb-6f8d-45a6-a31f-854a5f69bcde"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:29:05.879409 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:05.879323    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78008fcb-6f8d-45a6-a31f-854a5f69bcde-maas-api-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:29:06.582676 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:06.582645    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz"
Jul 10 14:29:06.582854 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:06.582681    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz" event={"ID":"78008fcb-6f8d-45a6-a31f-854a5f69bcde","Type":"ContainerDied","Data":"bbb846a207e1043f1d250f0b632706b56387ee673eea6266864d0757805cd488"}
Jul 10 14:29:06.582854 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:06.582730    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbb846a207e1043f1d250f0b632706b56387ee673eea6266864d0757805cd488"
Jul 10 14:29:11.060499 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.060292    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"]
Jul 10 14:29:11.060784 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.060488    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" podUID="f8511308-26f1-4454-a858-3a65eb9e5bdd" containerName="maas-api" containerID="cri-o://d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f" gracePeriod=30
Jul 10 14:29:11.310942 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.310870    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:29:11.431326 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.431273    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8511308-26f1-4454-a858-3a65eb9e5bdd-openshift-service-ca\") pod \"f8511308-26f1-4454-a858-3a65eb9e5bdd\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") "
Jul 10 14:29:11.431507 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.431376    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls\") pod \"f8511308-26f1-4454-a858-3a65eb9e5bdd\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") "
Jul 10 14:29:11.431507 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.431459    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n488\" (UniqueName: \"kubernetes.io/projected/f8511308-26f1-4454-a858-3a65eb9e5bdd-kube-api-access-5n488\") pod \"f8511308-26f1-4454-a858-3a65eb9e5bdd\" (UID: \"f8511308-26f1-4454-a858-3a65eb9e5bdd\") "
Jul 10 14:29:11.431726 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.431704    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8511308-26f1-4454-a858-3a65eb9e5bdd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8511308-26f1-4454-a858-3a65eb9e5bdd" (UID: "f8511308-26f1-4454-a858-3a65eb9e5bdd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:29:11.433509 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.433487    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8511308-26f1-4454-a858-3a65eb9e5bdd" (UID: "f8511308-26f1-4454-a858-3a65eb9e5bdd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:29:11.433588 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.433543    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8511308-26f1-4454-a858-3a65eb9e5bdd-kube-api-access-5n488" (OuterVolumeSpecName: "kube-api-access-5n488") pod "f8511308-26f1-4454-a858-3a65eb9e5bdd" (UID: "f8511308-26f1-4454-a858-3a65eb9e5bdd"). InnerVolumeSpecName "kube-api-access-5n488". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:29:11.532214 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.532181    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n488\" (UniqueName: \"kubernetes.io/projected/f8511308-26f1-4454-a858-3a65eb9e5bdd-kube-api-access-5n488\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:29:11.532214 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.532211    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8511308-26f1-4454-a858-3a65eb9e5bdd-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:29:11.532214 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.532222    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8511308-26f1-4454-a858-3a65eb9e5bdd-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:29:11.605944 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.605855    2561 generic.go:356] "Generic (PLEG): container finished" podID="f8511308-26f1-4454-a858-3a65eb9e5bdd" containerID="d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f" exitCode=0
Jul 10 14:29:11.605944 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.605895    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"
Jul 10 14:29:11.605944 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.605928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" event={"ID":"f8511308-26f1-4454-a858-3a65eb9e5bdd","Type":"ContainerDied","Data":"d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f"}
Jul 10 14:29:11.606221 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.605970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv" event={"ID":"f8511308-26f1-4454-a858-3a65eb9e5bdd","Type":"ContainerDied","Data":"9e1677c0b367d57619a19559ed2e27df4f99b557cf3e5128193288650b94c0bf"}
Jul 10 14:29:11.606221 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.605992    2561 scope.go:117] "RemoveContainer" containerID="d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f"
Jul 10 14:29:11.614989 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.614971    2561 scope.go:117] "RemoveContainer" containerID="d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f"
Jul 10 14:29:11.615287 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:29:11.615265    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f\": container with ID starting with d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f not found: ID does not exist" containerID="d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f"
Jul 10 14:29:11.615368 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.615299    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f"} err="failed to get container status \"d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f\": rpc error: code = NotFound desc = could not find container \"d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f\": container with ID starting with d7fb16344d2dd1201b698c34907052e38365615481d4824039fb306831c42f6f not found: ID does not exist"
Jul 10 14:29:11.630809 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.630771    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"]
Jul 10 14:29:11.635964 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:11.635940    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b5750f-79d868bb5b-b47sv"]
Jul 10 14:29:13.141762 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:13.141729    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8511308-26f1-4454-a858-3a65eb9e5bdd" path="/var/lib/kubelet/pods/f8511308-26f1-4454-a858-3a65eb9e5bdd/volumes"
Jul 10 14:29:30.167319 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167285    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"]
Jul 10 14:29:30.167753 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167626    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78008fcb-6f8d-45a6-a31f-854a5f69bcde" containerName="revoke-keys"
Jul 10 14:29:30.167753 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167637    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="78008fcb-6f8d-45a6-a31f-854a5f69bcde" containerName="revoke-keys"
Jul 10 14:29:30.167753 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167649    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8511308-26f1-4454-a858-3a65eb9e5bdd" containerName="maas-api"
Jul 10 14:29:30.167753 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167655    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8511308-26f1-4454-a858-3a65eb9e5bdd" containerName="maas-api"
Jul 10 14:29:30.167753 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167706    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8511308-26f1-4454-a858-3a65eb9e5bdd" containerName="maas-api"
Jul 10 14:29:30.167753 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.167717    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="78008fcb-6f8d-45a6-a31f-854a5f69bcde" containerName="revoke-keys"
Jul 10 14:29:30.172178 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.172157    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.176692 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.176665    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:29:30.176847 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.176826    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-t62zx\""
Jul 10 14:29:30.177373 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.177347    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:29:30.177877 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.177852    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e5410e-serving-cert\""
Jul 10 14:29:30.192327 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.192302    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"]
Jul 10 14:29:30.316160 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.316118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfzw\" (UniqueName: \"kubernetes.io/projected/3c619bb1-fd6a-4e90-95db-3ba37b043365-kube-api-access-dpfzw\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.316389 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.316208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.316389 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.316240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c619bb1-fd6a-4e90-95db-3ba37b043365-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.417696 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.417602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfzw\" (UniqueName: \"kubernetes.io/projected/3c619bb1-fd6a-4e90-95db-3ba37b043365-kube-api-access-dpfzw\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.417696 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.417658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.417696 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.417677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c619bb1-fd6a-4e90-95db-3ba37b043365-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.417932 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:29:30.417757    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-serving-cert: secret "maas-api-e2e-shared-a-e5410e-serving-cert" not found
Jul 10 14:29:30.417932 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:29:30.417838    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls podName:3c619bb1-fd6a-4e90-95db-3ba37b043365 nodeName:}" failed. No retries permitted until 2026-07-10 14:29:30.917815205 +0000 UTC m=+2346.302014103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls") pod "maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" (UID: "3c619bb1-fd6a-4e90-95db-3ba37b043365") : secret "maas-api-e2e-shared-a-e5410e-serving-cert" not found
Jul 10 14:29:30.418267 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.418251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c619bb1-fd6a-4e90-95db-3ba37b043365-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.433708 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.433670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfzw\" (UniqueName: \"kubernetes.io/projected/3c619bb1-fd6a-4e90-95db-3ba37b043365-kube-api-access-dpfzw\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.921962 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.921925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:30.924545 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:30.924519    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls\") pod \"maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:31.084141 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:31.084103    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:31.243328 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:31.243258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"]
Jul 10 14:29:31.245716 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:29:31.245689    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c619bb1_fd6a_4e90_95db_3ba37b043365.slice/crio-455fdde9e87d86883b5d8d56086f9f70c0b336d78b96c1a7f486717db89a1389 WatchSource:0}: Error finding container 455fdde9e87d86883b5d8d56086f9f70c0b336d78b96c1a7f486717db89a1389: Status 404 returned error can't find the container with id 455fdde9e87d86883b5d8d56086f9f70c0b336d78b96c1a7f486717db89a1389
Jul 10 14:29:31.702952 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:31.702917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" event={"ID":"3c619bb1-fd6a-4e90-95db-3ba37b043365","Type":"ContainerStarted","Data":"455fdde9e87d86883b5d8d56086f9f70c0b336d78b96c1a7f486717db89a1389"}
Jul 10 14:29:32.708378 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:32.708341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" event={"ID":"3c619bb1-fd6a-4e90-95db-3ba37b043365","Type":"ContainerStarted","Data":"f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97"}
Jul 10 14:29:32.708791 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:32.708470    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:32.731431 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:32.731381    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" podStartSLOduration=2.219091802 podStartE2EDuration="2.73136613s" totalImagesPullingTime="512.274328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:29:32.73009247 +0000 UTC m=+2348.114291389" watchObservedRunningTime="2026-07-10 14:29:32.73136613 +0000 UTC m=+2348.115565048"
Jul 10 14:29:38.322703 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.322660    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"]
Jul 10 14:29:38.328554 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.328533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.333141 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.333117    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-47e604-serving-cert\""
Jul 10 14:29:38.363393 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.363359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"]
Jul 10 14:29:38.389093 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.389035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.389260 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.389106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjvrg\" (UniqueName: \"kubernetes.io/projected/c06b53f3-e5fa-47ee-bceb-3278e09cd251-kube-api-access-qjvrg\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.389260 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.389136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06b53f3-e5fa-47ee-bceb-3278e09cd251-openshift-service-ca\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.489588 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.489549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.489770 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.489612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjvrg\" (UniqueName: \"kubernetes.io/projected/c06b53f3-e5fa-47ee-bceb-3278e09cd251-kube-api-access-qjvrg\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.489770 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.489649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06b53f3-e5fa-47ee-bceb-3278e09cd251-openshift-service-ca\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.489770 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:29:38.489698    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-serving-cert: secret "maas-api-e2e-shared-b-47e604-serving-cert" not found
Jul 10 14:29:38.489893 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:29:38.489774    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls podName:c06b53f3-e5fa-47ee-bceb-3278e09cd251 nodeName:}" failed. No retries permitted until 2026-07-10 14:29:38.989752735 +0000 UTC m=+2354.373951641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls") pod "maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" (UID: "c06b53f3-e5fa-47ee-bceb-3278e09cd251") : secret "maas-api-e2e-shared-b-47e604-serving-cert" not found
Jul 10 14:29:38.490409 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.490391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06b53f3-e5fa-47ee-bceb-3278e09cd251-openshift-service-ca\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.516867 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.516830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjvrg\" (UniqueName: \"kubernetes.io/projected/c06b53f3-e5fa-47ee-bceb-3278e09cd251-kube-api-access-qjvrg\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.717484 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.717411    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:29:38.993988 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.993896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:38.996336 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:38.996313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls\") pod \"maas-api-e2e-shared-b-47e604-95796dbc6-9xffl\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:39.238692 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:39.238657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:39.376447 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:39.376423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"]
Jul 10 14:29:39.379112 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:29:39.379069    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06b53f3_e5fa_47ee_bceb_3278e09cd251.slice/crio-778ffc2917d97e64eb3a86001edfe0a9f4350206406ab53744e83f2c32495cfd WatchSource:0}: Error finding container 778ffc2917d97e64eb3a86001edfe0a9f4350206406ab53744e83f2c32495cfd: Status 404 returned error can't find the container with id 778ffc2917d97e64eb3a86001edfe0a9f4350206406ab53744e83f2c32495cfd
Jul 10 14:29:39.739983 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:39.739951    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" event={"ID":"c06b53f3-e5fa-47ee-bceb-3278e09cd251","Type":"ContainerStarted","Data":"778ffc2917d97e64eb3a86001edfe0a9f4350206406ab53744e83f2c32495cfd"}
Jul 10 14:29:40.746297 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:40.746264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" event={"ID":"c06b53f3-e5fa-47ee-bceb-3278e09cd251","Type":"ContainerStarted","Data":"c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e"}
Jul 10 14:29:40.746715 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:40.746391    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:29:40.764988 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:40.764933    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" podStartSLOduration=2.334666578 podStartE2EDuration="2.764917862s" totalImagesPullingTime="430.251284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:29:40.763324925 +0000 UTC m=+2356.147523856" watchObservedRunningTime="2026-07-10 14:29:40.764917862 +0000 UTC m=+2356.149116781"
Jul 10 14:29:46.757858 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:29:46.757826    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:30:00.158271 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.158231    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"]
Jul 10 14:30:00.161901 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.161875    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"]
Jul 10 14:30:00.162079 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.162036    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"
Jul 10 14:30:00.168373 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.168228    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"]
Jul 10 14:30:00.169394 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.169159    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"
Jul 10 14:30:00.169700 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.169677    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qd8l\""
Jul 10 14:30:00.173089 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.173062    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"
Jul 10 14:30:00.174131 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.174103    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"]
Jul 10 14:30:00.183028 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.183000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"
Jul 10 14:30:00.183918 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.183888    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"]
Jul 10 14:30:00.186326 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.186300    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"]
Jul 10 14:30:00.193027 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.193005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"
Jul 10 14:30:00.224843 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.224812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"
Jul 10 14:30:00.362804 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.362761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"]
Jul 10 14:30:00.364099 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:30:00.364041    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54729b0_dbb7_4367_90c3_831fdcfa9f4c.slice/crio-9dcfd29c11bb2a08f2d02652504e4068772bc9c77b99abe060c14ad9be4fd2bc WatchSource:0}: Error finding container 9dcfd29c11bb2a08f2d02652504e4068772bc9c77b99abe060c14ad9be4fd2bc: Status 404 returned error can't find the container with id 9dcfd29c11bb2a08f2d02652504e4068772bc9c77b99abe060c14ad9be4fd2bc
Jul 10 14:30:00.380723 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.380695    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"]
Jul 10 14:30:00.383420 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:30:00.383388    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7017f8e9_b09f_4632_b655_1c67dd0ae183.slice/crio-bcf968a75ba85f067c4c4cf748d4cc7627ee8c61119cccb64e37be639d11e8c7 WatchSource:0}: Error finding container bcf968a75ba85f067c4c4cf748d4cc7627ee8c61119cccb64e37be639d11e8c7: Status 404 returned error can't find the container with id bcf968a75ba85f067c4c4cf748d4cc7627ee8c61119cccb64e37be639d11e8c7
Jul 10 14:30:00.408162 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.408116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"]
Jul 10 14:30:00.415436 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:30:00.415400    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055a1c0f_e619_4110_9198_811fc515fec2.slice/crio-a1727550800fa3c50594d5f0285db1840aa5814660bccad32596b99cfa841b71 WatchSource:0}: Error finding container a1727550800fa3c50594d5f0285db1840aa5814660bccad32596b99cfa841b71: Status 404 returned error can't find the container with id a1727550800fa3c50594d5f0285db1840aa5814660bccad32596b99cfa841b71
Jul 10 14:30:00.847615 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.847575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f" event={"ID":"055a1c0f-e619-4110-9198-811fc515fec2","Type":"ContainerStarted","Data":"f75b2cc321fb52d37027af76c9c7b215fa06b69f05be6e52ebdc8828396da97e"}
Jul 10 14:30:00.847815 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.847637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f" event={"ID":"055a1c0f-e619-4110-9198-811fc515fec2","Type":"ContainerStarted","Data":"a1727550800fa3c50594d5f0285db1840aa5814660bccad32596b99cfa841b71"}
Jul 10 14:30:00.849160 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.849135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8" event={"ID":"7017f8e9-b09f-4632-b655-1c67dd0ae183","Type":"ContainerStarted","Data":"72db554ca4c8134f9856a72d066dc182aa9b39365f3f393163a46d0e9f4a1651"}
Jul 10 14:30:00.849293 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.849178    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8" event={"ID":"7017f8e9-b09f-4632-b655-1c67dd0ae183","Type":"ContainerStarted","Data":"bcf968a75ba85f067c4c4cf748d4cc7627ee8c61119cccb64e37be639d11e8c7"}
Jul 10 14:30:00.850603 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.850582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc" event={"ID":"b54729b0-dbb7-4367-90c3-831fdcfa9f4c","Type":"ContainerStarted","Data":"0501eb75dabf59b59e1f33d3f1eef8eacfa86f91913df11503909010e4201c65"}
Jul 10 14:30:00.850698 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.850624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc" event={"ID":"b54729b0-dbb7-4367-90c3-831fdcfa9f4c","Type":"ContainerStarted","Data":"9dcfd29c11bb2a08f2d02652504e4068772bc9c77b99abe060c14ad9be4fd2bc"}
Jul 10 14:30:00.868923 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.868875    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f" podStartSLOduration=0.868861879 podStartE2EDuration="868.861879ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:30:00.867212548 +0000 UTC m=+2376.251411477" watchObservedRunningTime="2026-07-10 14:30:00.868861879 +0000 UTC m=+2376.253060797"
Jul 10 14:30:00.911802 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.911750    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8" podStartSLOduration=0.911735648 podStartE2EDuration="911.735648ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:30:00.910393399 +0000 UTC m=+2376.294592319" watchObservedRunningTime="2026-07-10 14:30:00.911735648 +0000 UTC m=+2376.295934546"
Jul 10 14:30:00.912122 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:00.912100    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc" podStartSLOduration=0.912091928 podStartE2EDuration="912.091928ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:30:00.890477417 +0000 UTC m=+2376.274676317" watchObservedRunningTime="2026-07-10 14:30:00.912091928 +0000 UTC m=+2376.296290846"
Jul 10 14:30:01.856601 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:01.856560    2561 generic.go:356] "Generic (PLEG): container finished" podID="7017f8e9-b09f-4632-b655-1c67dd0ae183" containerID="72db554ca4c8134f9856a72d066dc182aa9b39365f3f393163a46d0e9f4a1651" exitCode=0
Jul 10 14:30:01.857037 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:01.856646    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8" event={"ID":"7017f8e9-b09f-4632-b655-1c67dd0ae183","Type":"ContainerDied","Data":"72db554ca4c8134f9856a72d066dc182aa9b39365f3f393163a46d0e9f4a1651"}
Jul 10 14:30:01.858035 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:01.858016    2561 generic.go:356] "Generic (PLEG): container finished" podID="b54729b0-dbb7-4367-90c3-831fdcfa9f4c" containerID="0501eb75dabf59b59e1f33d3f1eef8eacfa86f91913df11503909010e4201c65" exitCode=0
Jul 10 14:30:01.858149 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:01.858084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc" event={"ID":"b54729b0-dbb7-4367-90c3-831fdcfa9f4c","Type":"ContainerDied","Data":"0501eb75dabf59b59e1f33d3f1eef8eacfa86f91913df11503909010e4201c65"}
Jul 10 14:30:01.859536 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:01.859511    2561 generic.go:356] "Generic (PLEG): container finished" podID="055a1c0f-e619-4110-9198-811fc515fec2" containerID="f75b2cc321fb52d37027af76c9c7b215fa06b69f05be6e52ebdc8828396da97e" exitCode=0
Jul 10 14:30:01.859648 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:01.859537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f" event={"ID":"055a1c0f-e619-4110-9198-811fc515fec2","Type":"ContainerDied","Data":"f75b2cc321fb52d37027af76c9c7b215fa06b69f05be6e52ebdc8828396da97e"}
Jul 10 14:30:03.019901 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.019877    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"
Jul 10 14:30:03.022825 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.022807    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"
Jul 10 14:30:03.055644 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.055619    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"
Jul 10 14:30:03.870286 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.870261    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"
Jul 10 14:30:03.870286 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.870271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8" event={"ID":"7017f8e9-b09f-4632-b655-1c67dd0ae183","Type":"ContainerDied","Data":"bcf968a75ba85f067c4c4cf748d4cc7627ee8c61119cccb64e37be639d11e8c7"}
Jul 10 14:30:03.870534 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.870319    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcf968a75ba85f067c4c4cf748d4cc7627ee8c61119cccb64e37be639d11e8c7"
Jul 10 14:30:03.871424 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.871405    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc"
Jul 10 14:30:03.871552 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.871441    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-cqprc" event={"ID":"b54729b0-dbb7-4367-90c3-831fdcfa9f4c","Type":"ContainerDied","Data":"9dcfd29c11bb2a08f2d02652504e4068772bc9c77b99abe060c14ad9be4fd2bc"}
Jul 10 14:30:03.871552 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.871484    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dcfd29c11bb2a08f2d02652504e4068772bc9c77b99abe060c14ad9be4fd2bc"
Jul 10 14:30:03.873005 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.872979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f" event={"ID":"055a1c0f-e619-4110-9198-811fc515fec2","Type":"ContainerDied","Data":"a1727550800fa3c50594d5f0285db1840aa5814660bccad32596b99cfa841b71"}
Jul 10 14:30:03.873005 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.872999    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"
Jul 10 14:30:03.873180 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:30:03.873012    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1727550800fa3c50594d5f0285db1840aa5814660bccad32596b99cfa841b71"
Jul 10 14:35:05.133591 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.133550    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"]
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.133951    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54729b0-dbb7-4367-90c3-831fdcfa9f4c" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.133967    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54729b0-dbb7-4367-90c3-831fdcfa9f4c" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.133983    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055a1c0f-e619-4110-9198-811fc515fec2" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.133988    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055a1c0f-e619-4110-9198-811fc515fec2" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.133997    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7017f8e9-b09f-4632-b655-1c67dd0ae183" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.134002    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7017f8e9-b09f-4632-b655-1c67dd0ae183" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.134082    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7017f8e9-b09f-4632-b655-1c67dd0ae183" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.134107    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055a1c0f-e619-4110-9198-811fc515fec2" containerName="cleanup"
Jul 10 14:35:05.134154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.134118    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54729b0-dbb7-4367-90c3-831fdcfa9f4c" containerName="cleanup"
Jul 10 14:35:05.138913 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.138896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:05.141642 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.141620    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qd8l\""
Jul 10 14:35:05.146146 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.146122    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"]
Jul 10 14:35:05.249235 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.249192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bba3cc-0bca-489f-a817-e6267dda60aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl\" (UID: \"d5bba3cc-0bca-489f-a817-e6267dda60aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:05.350679 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.350642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bba3cc-0bca-489f-a817-e6267dda60aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl\" (UID: \"d5bba3cc-0bca-489f-a817-e6267dda60aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:05.351352 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.351333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bba3cc-0bca-489f-a817-e6267dda60aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl\" (UID: \"d5bba3cc-0bca-489f-a817-e6267dda60aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:05.451195 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.451104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:05.589028 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:05.589006    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"]
Jul 10 14:35:05.590828 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:35:05.590801    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bba3cc_0bca_489f_a817_e6267dda60aa.slice/crio-ddd745ccc050631e24283aad9b6f5fa51f8817f1e397626bf1fba109bbc93b9e WatchSource:0}: Error finding container ddd745ccc050631e24283aad9b6f5fa51f8817f1e397626bf1fba109bbc93b9e: Status 404 returned error can't find the container with id ddd745ccc050631e24283aad9b6f5fa51f8817f1e397626bf1fba109bbc93b9e
Jul 10 14:35:06.315442 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:06.315409    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5bba3cc-0bca-489f-a817-e6267dda60aa" containerID="3ad04425f35d14d97fc151724e423f4dc0fa7421a56656383a9dae35054b5f8d" exitCode=0
Jul 10 14:35:06.315840 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:06.315501    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl" event={"ID":"d5bba3cc-0bca-489f-a817-e6267dda60aa","Type":"ContainerDied","Data":"3ad04425f35d14d97fc151724e423f4dc0fa7421a56656383a9dae35054b5f8d"}
Jul 10 14:35:06.315840 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:06.315568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl" event={"ID":"d5bba3cc-0bca-489f-a817-e6267dda60aa","Type":"ContainerStarted","Data":"ddd745ccc050631e24283aad9b6f5fa51f8817f1e397626bf1fba109bbc93b9e"}
Jul 10 14:35:07.445758 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:07.445727    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:07.467153 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:07.467121    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bba3cc-0bca-489f-a817-e6267dda60aa-maas-api-service-ca\") pod \"d5bba3cc-0bca-489f-a817-e6267dda60aa\" (UID: \"d5bba3cc-0bca-489f-a817-e6267dda60aa\") "
Jul 10 14:35:07.467546 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:07.467522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5bba3cc-0bca-489f-a817-e6267dda60aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5bba3cc-0bca-489f-a817-e6267dda60aa" (UID: "d5bba3cc-0bca-489f-a817-e6267dda60aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:07.568410 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:07.568379    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bba3cc-0bca-489f-a817-e6267dda60aa-maas-api-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:08.326805 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:08.326776    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl"
Jul 10 14:35:08.326993 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:08.326813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl" event={"ID":"d5bba3cc-0bca-489f-a817-e6267dda60aa","Type":"ContainerDied","Data":"ddd745ccc050631e24283aad9b6f5fa51f8817f1e397626bf1fba109bbc93b9e"}
Jul 10 14:35:08.326993 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:08.326861    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddd745ccc050631e24283aad9b6f5fa51f8817f1e397626bf1fba109bbc93b9e"
Jul 10 14:35:15.599307 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.599275    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"]
Jul 10 14:35:15.599773 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.599538    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" podUID="3c619bb1-fd6a-4e90-95db-3ba37b043365" containerName="maas-api" containerID="cri-o://f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97" gracePeriod=30
Jul 10 14:35:15.632457 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.632426    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"]
Jul 10 14:35:15.634962 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.634938    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e5410e-29728230-f54k8"]
Jul 10 14:35:15.849042 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.849016    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:35:15.944853 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.944753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c619bb1-fd6a-4e90-95db-3ba37b043365-openshift-service-ca\") pod \"3c619bb1-fd6a-4e90-95db-3ba37b043365\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") "
Jul 10 14:35:15.944853 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.944825    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls\") pod \"3c619bb1-fd6a-4e90-95db-3ba37b043365\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") "
Jul 10 14:35:15.945121 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.944904    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpfzw\" (UniqueName: \"kubernetes.io/projected/3c619bb1-fd6a-4e90-95db-3ba37b043365-kube-api-access-dpfzw\") pod \"3c619bb1-fd6a-4e90-95db-3ba37b043365\" (UID: \"3c619bb1-fd6a-4e90-95db-3ba37b043365\") "
Jul 10 14:35:15.945121 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.945020    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c619bb1-fd6a-4e90-95db-3ba37b043365-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c619bb1-fd6a-4e90-95db-3ba37b043365" (UID: "3c619bb1-fd6a-4e90-95db-3ba37b043365"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:15.945259 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.945242    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c619bb1-fd6a-4e90-95db-3ba37b043365-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:15.946994 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.946968    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c619bb1-fd6a-4e90-95db-3ba37b043365-kube-api-access-dpfzw" (OuterVolumeSpecName: "kube-api-access-dpfzw") pod "3c619bb1-fd6a-4e90-95db-3ba37b043365" (UID: "3c619bb1-fd6a-4e90-95db-3ba37b043365"). InnerVolumeSpecName "kube-api-access-dpfzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:35:15.946994 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:15.946972    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c619bb1-fd6a-4e90-95db-3ba37b043365" (UID: "3c619bb1-fd6a-4e90-95db-3ba37b043365"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:35:16.046331 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.046294    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpfzw\" (UniqueName: \"kubernetes.io/projected/3c619bb1-fd6a-4e90-95db-3ba37b043365-kube-api-access-dpfzw\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:16.046331 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.046324    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c619bb1-fd6a-4e90-95db-3ba37b043365-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:16.366918 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.366887    2561 generic.go:356] "Generic (PLEG): container finished" podID="3c619bb1-fd6a-4e90-95db-3ba37b043365" containerID="f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97" exitCode=0
Jul 10 14:35:16.367120 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.366937    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"
Jul 10 14:35:16.367120 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.366972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" event={"ID":"3c619bb1-fd6a-4e90-95db-3ba37b043365","Type":"ContainerDied","Data":"f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97"}
Jul 10 14:35:16.367120 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.367029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd" event={"ID":"3c619bb1-fd6a-4e90-95db-3ba37b043365","Type":"ContainerDied","Data":"455fdde9e87d86883b5d8d56086f9f70c0b336d78b96c1a7f486717db89a1389"}
Jul 10 14:35:16.367120 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.367066    2561 scope.go:117] "RemoveContainer" containerID="f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97"
Jul 10 14:35:16.376205 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.376188    2561 scope.go:117] "RemoveContainer" containerID="f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97"
Jul 10 14:35:16.376485 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:35:16.376461    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97\": container with ID starting with f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97 not found: ID does not exist" containerID="f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97"
Jul 10 14:35:16.376549 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.376493    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97"} err="failed to get container status \"f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97\": rpc error: code = NotFound desc = could not find container \"f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97\": container with ID starting with f6c60e7861cf3098c391c3deb6b5cc586af20eb5073da37623330cd9259d0e97 not found: ID does not exist"
Jul 10 14:35:16.388892 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.388863    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"]
Jul 10 14:35:16.391749 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:16.391721    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e5410e-76977f7449-dkdvd"]
Jul 10 14:35:17.142002 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:17.141968    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c619bb1-fd6a-4e90-95db-3ba37b043365" path="/var/lib/kubelet/pods/3c619bb1-fd6a-4e90-95db-3ba37b043365/volumes"
Jul 10 14:35:17.142411 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:17.142288    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7017f8e9-b09f-4632-b655-1c67dd0ae183" path="/var/lib/kubelet/pods/7017f8e9-b09f-4632-b655-1c67dd0ae183/volumes"
Jul 10 14:35:31.323310 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323277    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"]
Jul 10 14:35:31.323685 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323612    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c619bb1-fd6a-4e90-95db-3ba37b043365" containerName="maas-api"
Jul 10 14:35:31.323685 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323622    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c619bb1-fd6a-4e90-95db-3ba37b043365" containerName="maas-api"
Jul 10 14:35:31.323685 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323638    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bba3cc-0bca-489f-a817-e6267dda60aa" containerName="revoke-keys"
Jul 10 14:35:31.323685 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323643    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bba3cc-0bca-489f-a817-e6267dda60aa" containerName="revoke-keys"
Jul 10 14:35:31.323820 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323707    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5bba3cc-0bca-489f-a817-e6267dda60aa" containerName="revoke-keys"
Jul 10 14:35:31.323820 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.323718    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c619bb1-fd6a-4e90-95db-3ba37b043365" containerName="maas-api"
Jul 10 14:35:31.328015 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.327998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:31.330526 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.330507    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8qd8l\""
Jul 10 14:35:31.335559 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.335531    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"]
Jul 10 14:35:31.388169 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.388133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452b8947-6e9d-448d-84bb-05f3f8e1b3b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk\" (UID: \"452b8947-6e9d-448d-84bb-05f3f8e1b3b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:31.489205 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.489167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452b8947-6e9d-448d-84bb-05f3f8e1b3b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk\" (UID: \"452b8947-6e9d-448d-84bb-05f3f8e1b3b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:31.489799 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.489777    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452b8947-6e9d-448d-84bb-05f3f8e1b3b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk\" (UID: \"452b8947-6e9d-448d-84bb-05f3f8e1b3b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:31.639720 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.639625    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:31.775808 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:31.775726    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"]
Jul 10 14:35:31.778236 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:35:31.778203    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452b8947_6e9d_448d_84bb_05f3f8e1b3b5.slice/crio-d3bbb6d480139e7208d1c6308d33c1e20893549cec6bce24a360cb09dee3d871 WatchSource:0}: Error finding container d3bbb6d480139e7208d1c6308d33c1e20893549cec6bce24a360cb09dee3d871: Status 404 returned error can't find the container with id d3bbb6d480139e7208d1c6308d33c1e20893549cec6bce24a360cb09dee3d871
Jul 10 14:35:32.446057 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:32.446007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk" event={"ID":"452b8947-6e9d-448d-84bb-05f3f8e1b3b5","Type":"ContainerStarted","Data":"1737ffed35573425a302e0332f629839c6fb51815bd96bb5c0ac4586979d64cb"}
Jul 10 14:35:32.446529 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:32.446077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk" event={"ID":"452b8947-6e9d-448d-84bb-05f3f8e1b3b5","Type":"ContainerStarted","Data":"d3bbb6d480139e7208d1c6308d33c1e20893549cec6bce24a360cb09dee3d871"}
Jul 10 14:35:32.467820 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:32.467771    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk" podStartSLOduration=1.467755709 podStartE2EDuration="1.467755709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:35:32.467467256 +0000 UTC m=+2707.851666175" watchObservedRunningTime="2026-07-10 14:35:32.467755709 +0000 UTC m=+2707.851954628"
Jul 10 14:35:33.451975 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:33.451937    2561 generic.go:356] "Generic (PLEG): container finished" podID="452b8947-6e9d-448d-84bb-05f3f8e1b3b5" containerID="1737ffed35573425a302e0332f629839c6fb51815bd96bb5c0ac4586979d64cb" exitCode=0
Jul 10 14:35:33.452375 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:33.452017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk" event={"ID":"452b8947-6e9d-448d-84bb-05f3f8e1b3b5","Type":"ContainerDied","Data":"1737ffed35573425a302e0332f629839c6fb51815bd96bb5c0ac4586979d64cb"}
Jul 10 14:35:34.585083 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:34.585037    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:34.717991 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:34.717902    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452b8947-6e9d-448d-84bb-05f3f8e1b3b5-maas-api-service-ca\") pod \"452b8947-6e9d-448d-84bb-05f3f8e1b3b5\" (UID: \"452b8947-6e9d-448d-84bb-05f3f8e1b3b5\") "
Jul 10 14:35:34.718330 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:34.718311    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452b8947-6e9d-448d-84bb-05f3f8e1b3b5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "452b8947-6e9d-448d-84bb-05f3f8e1b3b5" (UID: "452b8947-6e9d-448d-84bb-05f3f8e1b3b5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:34.819362 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:34.819325    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/452b8947-6e9d-448d-84bb-05f3f8e1b3b5-maas-api-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:35.462019 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:35.461936    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk"
Jul 10 14:35:35.462019 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:35.461957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk" event={"ID":"452b8947-6e9d-448d-84bb-05f3f8e1b3b5","Type":"ContainerDied","Data":"d3bbb6d480139e7208d1c6308d33c1e20893549cec6bce24a360cb09dee3d871"}
Jul 10 14:35:35.462215 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:35.462027    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3bbb6d480139e7208d1c6308d33c1e20893549cec6bce24a360cb09dee3d871"
Jul 10 14:35:41.893219 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:41.893173    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"]
Jul 10 14:35:41.893724 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:41.893484    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" podUID="c06b53f3-e5fa-47ee-bceb-3278e09cd251" containerName="maas-api" containerID="cri-o://c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e" gracePeriod=30
Jul 10 14:35:41.933988 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:41.933957    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"]
Jul 10 14:35:41.936732 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:41.936704    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-47e604-29728230-jzx4f"]
Jul 10 14:35:42.154183 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.154110    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:35:42.293768 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.293726    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06b53f3-e5fa-47ee-bceb-3278e09cd251-openshift-service-ca\") pod \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") "
Jul 10 14:35:42.293768 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.293777    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjvrg\" (UniqueName: \"kubernetes.io/projected/c06b53f3-e5fa-47ee-bceb-3278e09cd251-kube-api-access-qjvrg\") pod \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") "
Jul 10 14:35:42.294043 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.293803    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls\") pod \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\" (UID: \"c06b53f3-e5fa-47ee-bceb-3278e09cd251\") "
Jul 10 14:35:42.294043 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.294152    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06b53f3-e5fa-47ee-bceb-3278e09cd251-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c06b53f3-e5fa-47ee-bceb-3278e09cd251" (UID: "c06b53f3-e5fa-47ee-bceb-3278e09cd251"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:42.294043 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.294214    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06b53f3-e5fa-47ee-bceb-3278e09cd251-openshift-service-ca\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.296076 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.296036    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c06b53f3-e5fa-47ee-bceb-3278e09cd251" (UID: "c06b53f3-e5fa-47ee-bceb-3278e09cd251"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:35:42.296076 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.296063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06b53f3-e5fa-47ee-bceb-3278e09cd251-kube-api-access-qjvrg" (OuterVolumeSpecName: "kube-api-access-qjvrg") pod "c06b53f3-e5fa-47ee-bceb-3278e09cd251" (UID: "c06b53f3-e5fa-47ee-bceb-3278e09cd251"). InnerVolumeSpecName "kube-api-access-qjvrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:35:42.395478 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.395440    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjvrg\" (UniqueName: \"kubernetes.io/projected/c06b53f3-e5fa-47ee-bceb-3278e09cd251-kube-api-access-qjvrg\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.395478 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.395472    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06b53f3-e5fa-47ee-bceb-3278e09cd251-maas-api-tls\") on node \"ip-10-0-129-218.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.496288 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.496196    2561 generic.go:356] "Generic (PLEG): container finished" podID="c06b53f3-e5fa-47ee-bceb-3278e09cd251" containerID="c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e" exitCode=0
Jul 10 14:35:42.496288 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.496245    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"
Jul 10 14:35:42.496288 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.496275    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" event={"ID":"c06b53f3-e5fa-47ee-bceb-3278e09cd251","Type":"ContainerDied","Data":"c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e"}
Jul 10 14:35:42.496525 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.496327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl" event={"ID":"c06b53f3-e5fa-47ee-bceb-3278e09cd251","Type":"ContainerDied","Data":"778ffc2917d97e64eb3a86001edfe0a9f4350206406ab53744e83f2c32495cfd"}
Jul 10 14:35:42.496525 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.496350    2561 scope.go:117] "RemoveContainer" containerID="c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e"
Jul 10 14:35:42.505673 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.505652    2561 scope.go:117] "RemoveContainer" containerID="c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e"
Jul 10 14:35:42.505931 ip-10-0-129-218 kubenswrapper[2561]: E0710 14:35:42.505911    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e\": container with ID starting with c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e not found: ID does not exist" containerID="c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e"
Jul 10 14:35:42.505975 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.505942    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e"} err="failed to get container status \"c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e\": rpc error: code = NotFound desc = could not find container \"c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e\": container with ID starting with c4d4394e7564fa1f48153353dd5e43a6cd4d843a0ba83c1fcdcd4aa6ddca6a9e not found: ID does not exist"
Jul 10 14:35:42.518722 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.518689    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"]
Jul 10 14:35:42.521952 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:42.521927    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-47e604-95796dbc6-9xffl"]
Jul 10 14:35:43.141751 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:43.141715    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="055a1c0f-e619-4110-9198-811fc515fec2" path="/var/lib/kubelet/pods/055a1c0f-e619-4110-9198-811fc515fec2/volumes"
Jul 10 14:35:43.142154 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:35:43.142088    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06b53f3-e5fa-47ee-bceb-3278e09cd251" path="/var/lib/kubelet/pods/c06b53f3-e5fa-47ee-bceb-3278e09cd251/volumes"
Jul 10 14:36:03.224319 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:03.224284    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9fc2g_76586a68-5c7d-48aa-a520-49313a3a9ba7/manager/0.log"
Jul 10 14:36:03.469653 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:03.469623    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-ml29k_0992a7b2-5bed-41af-9a1f-f0ab430f7c41/copy-manifests/0.log"
Jul 10 14:36:03.477796 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:03.477738    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-ml29k_0992a7b2-5bed-41af-9a1f-f0ab430f7c41/manager/0.log"
Jul 10 14:36:04.182523 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:04.182494    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29728230-cqprc_b54729b0-dbb7-4367-90c3-831fdcfa9f4c/cleanup/0.log"
Jul 10 14:36:04.623881 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:04.623855    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-b5750f-vmqmz_78008fcb-6f8d-45a6-a31f-854a5f69bcde/revoke-keys/0.log"
Jul 10 14:36:05.297396 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:05.297370    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-e5410e-t6nrl_d5bba3cc-0bca-489f-a817-e6267dda60aa/revoke-keys/0.log"
Jul 10 14:36:05.408614 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:05.408580    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-47e604-m7tnk_452b8947-6e9d-448d-84bb-05f3f8e1b3b5/revoke-keys/0.log"
Jul 10 14:36:08.158583 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:08.158553    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wjgzc_79e558fc-aa86-400e-a9ce-81fd5fb7a25d/discovery/0.log"
Jul 10 14:36:08.262942 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:08.262876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-rnf8s_1b41749d-5b5b-4db5-bd17-9781bd8f41fe/kube-auth-proxy/0.log"
Jul 10 14:36:17.127908 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:17.127861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qkdpl_6672fb14-fb97-4899-b368-e55e1a7b6c20/global-pull-secret-syncer/0.log"
Jul 10 14:36:17.374411 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:17.374370    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dgxkz_6cf0070a-1d3a-4825-a0c3-96e51fa60e1b/konnectivity-agent/0.log"
Jul 10 14:36:17.400284 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:17.400160    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-218.ec2.internal_1452b6b6e59b37d37fbed58ab4b2c18d/haproxy/0.log"
Jul 10 14:36:25.003912 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.003874    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/alertmanager/0.log"
Jul 10 14:36:25.036097 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.036067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/config-reloader/0.log"
Jul 10 14:36:25.069862 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.069806    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/kube-rbac-proxy-web/0.log"
Jul 10 14:36:25.100116 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.100042    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/kube-rbac-proxy/0.log"
Jul 10 14:36:25.124493 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.124464    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/kube-rbac-proxy-metric/0.log"
Jul 10 14:36:25.149647 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.149615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/prom-label-proxy/0.log"
Jul 10 14:36:25.179365 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.179337    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8003511-b7f8-4e04-adf7-ea7ae6dc9c87/init-config-reloader/0.log"
Jul 10 14:36:25.353426 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.353397    2561 scope.go:117] "RemoveContainer" containerID="f75b2cc321fb52d37027af76c9c7b215fa06b69f05be6e52ebdc8828396da97e"
Jul 10 14:36:25.361705 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.361680    2561 scope.go:117] "RemoveContainer" containerID="72db554ca4c8134f9856a72d066dc182aa9b39365f3f393163a46d0e9f4a1651"
Jul 10 14:36:25.583589 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.583556    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6nrk_cac72f76-6d93-4603-9c21-0c9de1150295/node-exporter/0.log"
Jul 10 14:36:25.606445 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.606419    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6nrk_cac72f76-6d93-4603-9c21-0c9de1150295/kube-rbac-proxy/0.log"
Jul 10 14:36:25.628879 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.628853    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6nrk_cac72f76-6d93-4603-9c21-0c9de1150295/init-textfile/0.log"
Jul 10 14:36:25.664002 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.663971    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-9p84s_4e790df6-80c7-422a-9eb9-343e970cdb1b/kube-rbac-proxy-main/0.log"
Jul 10 14:36:25.688300 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.688274    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-9p84s_4e790df6-80c7-422a-9eb9-343e970cdb1b/kube-rbac-proxy-self/0.log"
Jul 10 14:36:25.711941 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.711897    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-9p84s_4e790df6-80c7-422a-9eb9-343e970cdb1b/openshift-state-metrics/0.log"
Jul 10 14:36:25.758831 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.758802    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/prometheus/0.log"
Jul 10 14:36:25.786944 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.786909    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/config-reloader/0.log"
Jul 10 14:36:25.834120 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.834001    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/thanos-sidecar/0.log"
Jul 10 14:36:25.877880 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.877855    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/kube-rbac-proxy-web/0.log"
Jul 10 14:36:25.915633 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.915607    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/kube-rbac-proxy/0.log"
Jul 10 14:36:25.948552 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.948525    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/kube-rbac-proxy-thanos/0.log"
Jul 10 14:36:25.974453 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:25.974427    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57f748d9-c66b-47b4-af65-7a8e11710f4e/init-config-reloader/0.log"
Jul 10 14:36:26.085735 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:26.085661    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85cccbfd49-m6bm8_a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd/telemeter-client/0.log"
Jul 10 14:36:26.110098 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:26.110076    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85cccbfd49-m6bm8_a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd/reload/0.log"
Jul 10 14:36:26.132942 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:26.132912    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85cccbfd49-m6bm8_a2e5a8c0-b9b2-44f1-9d67-32ebccbb92bd/kube-rbac-proxy/0.log"
Jul 10 14:36:27.315605 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.315574    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"]
Jul 10 14:36:27.315990 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.315917    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452b8947-6e9d-448d-84bb-05f3f8e1b3b5" containerName="revoke-keys"
Jul 10 14:36:27.315990 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.315929    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="452b8947-6e9d-448d-84bb-05f3f8e1b3b5" containerName="revoke-keys"
Jul 10 14:36:27.315990 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.315946    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06b53f3-e5fa-47ee-bceb-3278e09cd251" containerName="maas-api"
Jul 10 14:36:27.315990 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.315953    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06b53f3-e5fa-47ee-bceb-3278e09cd251" containerName="maas-api"
Jul 10 14:36:27.316153 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.316011    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="452b8947-6e9d-448d-84bb-05f3f8e1b3b5" containerName="revoke-keys"
Jul 10 14:36:27.316153 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.316021    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c06b53f3-e5fa-47ee-bceb-3278e09cd251" containerName="maas-api"
Jul 10 14:36:27.320591 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.320567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.323352 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.323328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2vrfh\"/\"kube-root-ca.crt\""
Jul 10 14:36:27.324362 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.324345    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2vrfh\"/\"openshift-service-ca.crt\""
Jul 10 14:36:27.324460 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.324350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2vrfh\"/\"default-dockercfg-cn9ln\""
Jul 10 14:36:27.335893 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.335866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"]
Jul 10 14:36:27.484151 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.484112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-podres\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.484375 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.484183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-lib-modules\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.484375 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.484310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4c2\" (UniqueName: \"kubernetes.io/projected/ca38343a-a104-44d1-a505-cfc3e29cf48f-kube-api-access-hv4c2\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.484375 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.484361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-sys\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.484522 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.484391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-proc\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.585776 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-podres\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.585776 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-lib-modules\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4c2\" (UniqueName: \"kubernetes.io/projected/ca38343a-a104-44d1-a505-cfc3e29cf48f-kube-api-access-hv4c2\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-sys\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-proc\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-podres\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586007 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.585952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-lib-modules\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586226 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.586020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-sys\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.586226 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.586092    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ca38343a-a104-44d1-a505-cfc3e29cf48f-proc\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.597891 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.597866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4c2\" (UniqueName: \"kubernetes.io/projected/ca38343a-a104-44d1-a505-cfc3e29cf48f-kube-api-access-hv4c2\") pod \"perf-node-gather-daemonset-r4crn\" (UID: \"ca38343a-a104-44d1-a505-cfc3e29cf48f\") " pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.631025 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.630966    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:27.773869 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:27.773843    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"]
Jul 10 14:36:27.776463 ip-10-0-129-218 kubenswrapper[2561]: W0710 14:36:27.776431    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podca38343a_a104_44d1_a505_cfc3e29cf48f.slice/crio-ca1fa7d9a08c0f811a6361f6b9771434e6ccd683974b99a7ceeb3ebb854eea0e WatchSource:0}: Error finding container ca1fa7d9a08c0f811a6361f6b9771434e6ccd683974b99a7ceeb3ebb854eea0e: Status 404 returned error can't find the container with id ca1fa7d9a08c0f811a6361f6b9771434e6ccd683974b99a7ceeb3ebb854eea0e
Jul 10 14:36:28.715503 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:28.715466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn" event={"ID":"ca38343a-a104-44d1-a505-cfc3e29cf48f","Type":"ContainerStarted","Data":"e2c115ab8ac2cee28c5f7fa44561f9c67e3fdc2ee9dacd2e0ceaf215b71f3924"}
Jul 10 14:36:28.715918 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:28.715519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn" event={"ID":"ca38343a-a104-44d1-a505-cfc3e29cf48f","Type":"ContainerStarted","Data":"ca1fa7d9a08c0f811a6361f6b9771434e6ccd683974b99a7ceeb3ebb854eea0e"}
Jul 10 14:36:28.715918 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:28.715559    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:28.744593 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:28.744538    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn" podStartSLOduration=1.744520423 podStartE2EDuration="1.744520423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:28.743790269 +0000 UTC m=+2764.127989188" watchObservedRunningTime="2026-07-10 14:36:28.744520423 +0000 UTC m=+2764.128719377"
Jul 10 14:36:30.803678 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:30.803638    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jdfjw_058f1c2e-e879-4db1-8459-19ca17626c3f/dns/0.log"
Jul 10 14:36:30.828691 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:30.828648    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jdfjw_058f1c2e-e879-4db1-8459-19ca17626c3f/kube-rbac-proxy/0.log"
Jul 10 14:36:30.942440 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:30.942401    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ms2rz_7f2587ff-aeec-4506-8144-77bc9d01c0a8/dns-node-resolver/0.log"
Jul 10 14:36:31.572763 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:31.572735    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-655c5fbdf5-vcvz8_2ba773c6-2fb5-4fbb-9cca-fe4cbc5f03c1/registry/0.log"
Jul 10 14:36:31.643989 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:31.643961    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gtnzm_5d69539e-a2c9-4dec-9b69-e0d24f8c59aa/node-ca/0.log"
Jul 10 14:36:32.843795 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:32.843747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wjgzc_79e558fc-aa86-400e-a9ce-81fd5fb7a25d/discovery/0.log"
Jul 10 14:36:32.872554 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:32.872528    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-rnf8s_1b41749d-5b5b-4db5-bd17-9781bd8f41fe/kube-auth-proxy/0.log"
Jul 10 14:36:33.989495 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:33.989466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dvpf_dca29636-30b6-454f-b9b9-686605b7a51a/serve-healthcheck-canary/0.log"
Jul 10 14:36:34.624237 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:34.624207    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rjgq9_8d7c57ff-c508-40ae-8b14-9e46b6f55ea3/insights-operator/0.log"
Jul 10 14:36:34.625123 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:34.625100    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rjgq9_8d7c57ff-c508-40ae-8b14-9e46b6f55ea3/insights-operator/1.log"
Jul 10 14:36:34.647542 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:34.647519    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-65c5g_6cacac01-3507-4409-8daf-e2bee302c657/kube-rbac-proxy/0.log"
Jul 10 14:36:34.673522 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:34.673500    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-65c5g_6cacac01-3507-4409-8daf-e2bee302c657/exporter/0.log"
Jul 10 14:36:34.695754 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:34.695732    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-65c5g_6cacac01-3507-4409-8daf-e2bee302c657/extractor/0.log"
Jul 10 14:36:34.730346 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:34.730319    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2vrfh/perf-node-gather-daemonset-r4crn"
Jul 10 14:36:37.903706 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:37.903672    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9fc2g_76586a68-5c7d-48aa-a520-49313a3a9ba7/manager/0.log"
Jul 10 14:36:38.037069 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:38.037019    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wjgzc_79e558fc-aa86-400e-a9ce-81fd5fb7a25d/discovery/0.log"
Jul 10 14:36:38.047354 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:38.047329    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-rnf8s_1b41749d-5b5b-4db5-bd17-9781bd8f41fe/kube-auth-proxy/0.log"
Jul 10 14:36:38.053626 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:38.053606    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-ml29k_0992a7b2-5bed-41af-9a1f-f0ab430f7c41/manager/0.log"
Jul 10 14:36:38.081814 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:38.081781    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545b4db9db-ml29k_0992a7b2-5bed-41af-9a1f-f0ab430f7c41/copy-manifests/0.log"
Jul 10 14:36:39.489192 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:39.489163    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-745c8d65dc-5bhvk_05693ae0-146e-4fda-9922-de256a02d365/manager/0.log"
Jul 10 14:36:39.740955 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:39.740870    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wjgzc_79e558fc-aa86-400e-a9ce-81fd5fb7a25d/discovery/0.log"
Jul 10 14:36:39.755168 ip-10-0-129-218 kubenswrapper[2561]: I0710 14:36:39.755142    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c9db8d9c-rnf8s_1b41749d-5b5b-4db5-bd17-9781bd8f41fe/kube-auth-proxy/0.log"