Jul 02 19:01:13.259279 ip-10-0-141-37 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.694580    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698433    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698444    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698447    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698451    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698453    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698457    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698459    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:13.803087 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698462    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:13.769309 ip-10-0-141-37 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698465    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698467    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698470    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698473    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698476    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698479    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698481    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698484    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698486    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698490    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698492    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698495    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698498    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698500    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698503    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698505    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698508    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698510    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:13.833824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698512    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698515    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698518    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698520    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698523    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698526    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698528    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698531    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698534    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698536    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698539    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698541    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698544    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698547    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698549    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698552    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698555    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698557    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698560    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698563    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:14.044575 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698566    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698569    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698571    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698574    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698576    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698579    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698581    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698584    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698586    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698589    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698592    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698594    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698597    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698600    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698602    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698605    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698607    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698610    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698613    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698615    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:14.055858 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698618    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698621    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698624    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698627    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698629    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698633    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698638    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698641    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698644    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698648    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698652    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698655    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698658    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698661    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698663    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698666    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698669    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698672    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698675    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:14.056743 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698678    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698681    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698684    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698687    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698690    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698694    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698698    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698701    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698703    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698706    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698708    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698711    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698713    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.698716    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699426    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699435    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699439    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699442    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699446    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:14.057562 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699449    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699452    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699455    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699458    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699461    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699464    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699466    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699469    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699472    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699474    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699477    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699480    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699482    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699485    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699487    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699490    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699492    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699494    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699497    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699499    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:14.058188 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699502    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699504    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699506    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699512    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699514    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699517    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699519    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699522    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699525    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699528    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699531    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699534    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699537    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699539    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699542    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699544    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699546    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699550    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699552    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699555    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:14.059038 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699557    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699559    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699562    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699564    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699567    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699569    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699572    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699575    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699577    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699580    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699582    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699584    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699587    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699589    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699591    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699595    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699598    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699600    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699603    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699605    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:14.059631 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699608    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699611    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699613    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699615    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699618    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699621    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699623    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699626    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699628    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699631    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699634    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699636    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699639    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699642    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699645    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699647    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699650    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699652    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699655    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:14.060451 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699657    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699659    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699662    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699665    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699668    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699671    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699674    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699677    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699682    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699686    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699689    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699693    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699696    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699698    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.699701    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700114    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700120    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700124    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700127    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:14.061284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700130    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700132    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700135    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700137    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700141    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700143    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700147    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700151    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700154    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700157    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700160    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700162    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700165    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700168    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700171    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700173    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700176    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700178    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700181    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700183    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:14.061942 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700186    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700191    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700193    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700196    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700200    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700203    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700205    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700208    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700210    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700214    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700216    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700219    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700221    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700224    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700226    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700229    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700231    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700234    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700236    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700239    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:14.062545 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700243    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700246    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700249    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700252    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700254    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700257    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700259    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700262    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700264    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700267    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700269    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700272    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700274    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700278    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700281    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700283    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700287    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700289    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700292    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700294    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:14.063234 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700297    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700299    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700302    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700304    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700306    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700309    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700313    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700315    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700318    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700320    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700323    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700326    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700328    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700330    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700333    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700335    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700338    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700340    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700343    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:14.063805 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700347    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700350    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700353    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700356    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700359    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700361    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700365    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700368    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700370    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700374    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700377    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700379    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700381    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700384    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700387    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.700389    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700451    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700457    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700463    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700468    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700471    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:01:14.064416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700475    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700478    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700482    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700486    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700489    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700493    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700496    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700499    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700502    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700505    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700508    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700511    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700514    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700517    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700520    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700523    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700526    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700531    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700534    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700537    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700542    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700545    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700548    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700551    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:01:14.064970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700554    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700557    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700559    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700563    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700566    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700569    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700572    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700575    2567 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700578    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700582    2567 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700585    2567 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700588    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700592    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700594    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700598    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700601    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700604    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700607    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700610    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700612    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700615    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700618    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700621    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700624    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700626    2567 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:01:14.065751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700631    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700634    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700637    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700641    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700644    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700647    2567 flags.go:64] FLAG: --help="false"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700650    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700653    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700656    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700659    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700662    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700665    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700668    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700671    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700674    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700677    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700680    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700683    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700686    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700688    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700692    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700694    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700697    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700700    2567 flags.go:64] FLAG: --lock-file=""
Jul 02 19:01:14.066599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700703    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700705    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700708    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700713    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700716    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700719    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700721    2567 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700724    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700729    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700731    2567 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700734    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700740    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700743    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700747    2567 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700750    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700753    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700756    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700758    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700761    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700764    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700767    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700773    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700776    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700779    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:01:14.067380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700782    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700785    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700789    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700792    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700796    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700802    2567 flags.go:64] FLAG: --port="10250"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700806    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700811    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cb9c7ee013712fbf"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700814    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700818    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700821    2567 flags.go:64] FLAG: --register-node="true"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700824    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700827    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700830    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700832    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700835    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700840    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700843    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700846    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700849    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700853    2567 flags.go:64] FLAG: --runonce="false"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700856    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700859    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700862    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700865    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:01:14.068138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700868    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700871    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700874    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700877    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700880    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700882    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700885    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700888    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700891    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700894    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700897    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700902    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700905    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700908    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700912    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700915    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700917    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700920    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700923    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700926    2567 flags.go:64] FLAG: --v="2"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700932    2567 flags.go:64] FLAG: --version="false"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700937    2567 flags.go:64] FLAG: --vmodule=""
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700940    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.700946    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701074    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:14.068910 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701077    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701080    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701085    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701088    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701090    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701093    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701096    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701098    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701101    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701103    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701106    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701108    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701111    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701114    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701116    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701120    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701123    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701126    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701129    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701132    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:14.069983 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701134    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701137    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701140    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701142    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701145    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701147    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701149    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701152    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701154    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701157    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701160    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701164    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701168    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701170    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701174    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701177    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701179    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701182    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701185    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:14.070643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701187    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701190    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701192    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701195    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701197    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701200    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701203    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701205    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701208    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701210    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701213    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701215    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701218    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701220    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701223    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701226    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701228    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701231    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701234    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701236    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:14.220487 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701239    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701241    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701244    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701249    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701252    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701255    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701257    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701261    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701264    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701267    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701270    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701273    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701276    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701279    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701282    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701284    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701287    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701290    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701293    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:14.221095 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701295    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701298    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701300    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701303    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701306    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701308    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701310    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701313    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701315    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701318    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701321    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701323    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701326    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701328    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701331    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701333    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701337    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701339    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701342    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:14.221624 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.701344    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.702070    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.710248    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.710262    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.711082    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.711089    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711143    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711148    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711151    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711154    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711157    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711159    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711162    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711165    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711168    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:14.222181 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711171    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711173    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711176    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711179    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711181    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711191    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711194    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711197    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711200    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711202    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711205    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711208    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711210    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711213    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711218    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711221    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711225    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711228    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711231    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711234    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:14.222633 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711237    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711240    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711242    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711246    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711250    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711253    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711256    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711259    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711261    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711264    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711267    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711270    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711272    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711275    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711277    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711280    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711282    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711285    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711288    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:14.223208 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711290    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711296    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711298    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711301    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711303    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711306    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711308    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711314    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711317    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711320    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711322    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711325    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711328    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711330    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711333    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711335    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711338    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711340    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711343    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:14.223718 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711347    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711350    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711353    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711356    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711358    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711361    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711364    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711366    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711369    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711371    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711374    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711377    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711379    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711381    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711385    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711388    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711391    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711393    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711396    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:14.224263 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711398    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711402    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711405    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711407    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711410    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711412    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711415    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711418    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711420    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711423    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711425    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711428    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711431    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.711436    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711543    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:01:14.224767 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711547    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711550    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711553    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711555    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711558    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711560    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711563    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711565    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711568    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711570    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711573    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711575    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711580    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711584    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711588    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711591    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711594    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711596    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711599    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711603    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:01:14.225220 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711606    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711608    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711611    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711613    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711616    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711618    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711621    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711623    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711626    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711629    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711631    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711634    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711636    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711640    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711644    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711647    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711650    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711652    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711655    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:01:14.225736 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711657    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711660    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711662    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711665    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711667    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711671    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711673    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711676    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711679    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711681    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711684    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711686    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711690    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711692    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711695    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711698    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711700    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711703    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711705    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711708    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:01:14.226282 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711711    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711713    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711716    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711718    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711721    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711723    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711726    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711728    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711731    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711733    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711736    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711738    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711741    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711743    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711746    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711748    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711751    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711755    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711758    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:01:14.226797 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711762    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711764    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711767    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711770    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711773    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711777    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711780    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711782    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711785    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711787    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711790    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711793    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711795    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711797    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711800    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711802    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711805    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711807    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711810    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:01:14.227358 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:13.711812    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.711817    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.711906    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.714172    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.715768    2567 server.go:1019] "Starting client certificate rotation"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.715866    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.715894    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.718685    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.720171    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.730259    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.733131    2567 log.go:25] "Validated CRI v1 image API"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.734029    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:01:14.227861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.740401    2567 fs.go:135] Filesystem UUIDs: map[08a86057-6001-4ff0-8f00-5308e96b7f85:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b720bfed-dd47-4e5e-ae4b-6c1938c71c02:/dev/nvme0n1p3]
Jul 02 19:01:14.228268 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.740420    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.746832    2567 manager.go:216] Machine: {Timestamp:2026-07-02 19:01:13.745411876 +0000 UTC m=+0.363137945 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102765 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aadb7e4b40bd006fb32266e7e6a15 SystemUUID:ec2aadb7-e4b4-0bd0-06fb-32266e7e6a15 BootID:d858e63d-7b18-4617-8299-3c0afb8360f2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:b4:8c:bc:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:b4:8c:bc:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:ef:d7:2a:07:91 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.746931    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.746998    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.747116    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.750430    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.750458    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:01:14.228338 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.751260    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.751270    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.751278    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.751912    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.753709    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757088    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757207    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757232    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757241    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757254    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757262    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757273    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757554    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.757568    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.760098    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.762434    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.762461    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.763973    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.763988    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.763994    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.763999    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764008    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764034    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764045    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764053    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764060    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764066    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764074    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764079    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764902    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.764911    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.766676    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.766713    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.766865    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.768501    2567 server.go:1268] "Started kubelet"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.768589    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.768681    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.768735    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.774360    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.775624    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f9nhc"
Jul 02 19:01:14.228615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.776189    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.776633    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.778326    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-37.ec2.internal.18be8e3806c96c60  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-37.ec2.internal,UID:ip-10-0-141-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-37.ec2.internal,},FirstTimestamp:2026-07-02 19:01:13.768471648 +0000 UTC m=+0.386197719,LastTimestamp:2026-07-02 19:01:13.768471648 +0000 UTC m=+0.386197719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-37.ec2.internal,}"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.780920    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f9nhc"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.781847    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.781856    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.781946    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782559    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782584    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782559    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782665    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782676    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782683    2567 factory.go:55] Registering systemd factory
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782697    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782881    2567 factory.go:153] Registering CRI-O factory
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782897    2567 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782971    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.782993    2567 factory.go:103] Registering Raw factory
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.783008    2567 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.783437    2567 manager.go:349] Starting recovery of all containers
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.784863    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.784939    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.793635    2567 manager.go:354] Recovery completed
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.797735    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.800828    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.800857    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.800869    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.801792    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.801792    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.801854    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.801870    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.802896    2567 policy_none.go:49] "None policy: Start"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.802909    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.802919    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:01:14.229644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.803848    2567 policy_none.go:47] "Start"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.804472    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.804489    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.804498    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.882490    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.889636    2567 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.889703    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.889715    2567 server.go:87] "Starting device plugin registration server"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.889936    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.889949    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.890138    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.890229    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.890239    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.890694    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.890733    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.932332    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.933503    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.933541    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.933569    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.933609    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.935792    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.990524    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.990610    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-37.ec2.internal\" not found" node="ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.991421    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.991457    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.991468    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.991490    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:13.999601    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:13.999617    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-37.ec2.internal\": node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.034702    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"]
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.034825    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.036549    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.036575    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.036587    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.037826    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.038023    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.230585 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.038059    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.039063    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.039085    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.039096    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.039337    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.039351    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.039363    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.040533    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.040558    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.041399    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.041419    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.041431    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.047746    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.063554    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-37.ec2.internal\" not found" node="ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.067543    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-37.ec2.internal\" not found" node="ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.084227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2af57e46ea7583b75164ae638dc6a086-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal\" (UID: \"2af57e46ea7583b75164ae638dc6a086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.084252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af57e46ea7583b75164ae638dc6a086-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal\" (UID: \"2af57e46ea7583b75164ae638dc6a086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.084271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb15ed011179ac858abbc3d152c7f014-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.ec2.internal\" (UID: \"cb15ed011179ac858abbc3d152c7f014\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.148535    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.185077    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2af57e46ea7583b75164ae638dc6a086-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal\" (UID: \"2af57e46ea7583b75164ae638dc6a086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.185035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2af57e46ea7583b75164ae638dc6a086-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal\" (UID: \"2af57e46ea7583b75164ae638dc6a086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.233753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.185123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af57e46ea7583b75164ae638dc6a086-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal\" (UID: \"2af57e46ea7583b75164ae638dc6a086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.185139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb15ed011179ac858abbc3d152c7f014-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.ec2.internal\" (UID: \"cb15ed011179ac858abbc3d152c7f014\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.185168    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb15ed011179ac858abbc3d152c7f014-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.ec2.internal\" (UID: \"cb15ed011179ac858abbc3d152c7f014\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.185189    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af57e46ea7583b75164ae638dc6a086-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal\" (UID: \"2af57e46ea7583b75164ae638dc6a086\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.249544    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.349980    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.366068    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.379624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.370908    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:14.520736 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.450777    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.649559 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.551208    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.777478 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.652943    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.777478 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.716105    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:01:14.777478 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.716295    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:01:14.777478 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.754912    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:14.902629 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.780126    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:14.902629 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.787397    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:56:14 +0000 UTC" deadline="2028-01-28 04:02:37.653321485 +0000 UTC"
Jul 02 19:01:14.902629 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.787421    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13785h1m22.865903053s"
Jul 02 19:01:14.902629 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.856573    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:15.030276 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:14.956900    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-37.ec2.internal\" not found"
Jul 02 19:01:15.030276 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.971256    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:15.030276 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:14.983027    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:15.030276 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.004818    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:01:15.030276 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.006922    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal"
Jul 02 19:01:15.030276 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.015295    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:01:15.179268 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:15.063310    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb15ed011179ac858abbc3d152c7f014.slice/crio-394fb6a5e16cd9895ad9dd107aaa524f1a1fcf25a468cf2b2cd9bf3155470424 WatchSource:0}: Error finding container 394fb6a5e16cd9895ad9dd107aaa524f1a1fcf25a468cf2b2cd9bf3155470424: Status 404 returned error can't find the container with id 394fb6a5e16cd9895ad9dd107aaa524f1a1fcf25a468cf2b2cd9bf3155470424
Jul 02 19:01:15.179268 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.068805    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:01:15.179268 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.160539    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.758953    2567 apiserver.go:52] "Watching apiserver"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.768016    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.772953    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hwlrt","openshift-ovn-kubernetes/ovnkube-node-gxj45","kube-system/global-pull-secret-syncer-ntq7g","openshift-cluster-node-tuning-operator/tuned-l6qb7","openshift-dns/node-resolver-dhjtj","openshift-image-registry/node-ca-xqdfw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal","openshift-multus/multus-additional-cni-plugins-lpzg4","openshift-network-diagnostics/network-check-target-76nvm","kube-system/konnectivity-agent-x6l4g","kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8","openshift-multus/multus-mllw2","openshift-multus/network-metrics-daemon-q7j9f"]
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.775314    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.776335    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mllw2"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.777524    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:15.777605    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.778698    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.778779    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.779483    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.779696    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9zgnk\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.779803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.779813    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.779923    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.780005    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.780229    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.780282    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x7hh9\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.781257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.783230    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.783644    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-747lx\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.783929    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.784148    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zwf76\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.784344    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:15.784390    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.788799    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:01:15.790038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.789025    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:01:15.791377 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.789168    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:01:15.791377 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.789296    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxdpn\""
Jul 02 19:01:15.791377 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.789383    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:01:15.794467 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.792765    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:01:15.794467 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.793397    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-os-release\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-hostroot\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-multus-certs\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ckjk\" (UniqueName: \"kubernetes.io/projected/ab8ca1a5-a051-4f14-9a79-8aea351b857e-kube-api-access-6ckjk\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm8fc\" (UniqueName: \"kubernetes.io/projected/f305ca40-f959-4dc4-a645-e3b3094d1d83-kube-api-access-mm8fc\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911679    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-cni-netd\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:15.943331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:15.911705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2cjd\" (UniqueName: \"kubernetes.io/projected/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-kube-api-access-q2cjd\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-system-cni-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-etc-kubernetes\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-kubernetes\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysctl-d\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027765    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ab89a9b-52b3-46e9-a219-9a23779478dc-host\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-systemd-units\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-socket-dir-parent\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysconfig\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.027881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a773485-54c9-40aa-8c58-e36909f69126-agent-certs\") pod \"konnectivity-agent-x6l4g\" (UID: \"4a773485-54c9-40aa-8c58-e36909f69126\") " pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-sys\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027981    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-lib-modules\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-systemd\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028046    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f305ca40-f959-4dc4-a645-e3b3094d1d83-tmp\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5pf\" (UniqueName: \"kubernetes.io/projected/1ab89a9b-52b3-46e9-a219-9a23779478dc-kube-api-access-qk5pf\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-kubelet\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-netns\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028200    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-kubelet\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-daemon-config\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-systemd\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-var-lib-kubelet\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.094015 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-hosts-file\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-tmp-dir\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-ovn\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-conf-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.027744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.028497    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb7b2256-9d00-45a5-9beb-203f649a7b03-kubelet-config\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-modprobe-d\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysctl-conf\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028803    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-slash\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028832    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-env-overrides\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab8ca1a5-a051-4f14-9a79-8aea351b857e-cni-binary-copy\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-etc-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-node-log\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-cni-bin\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.028993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d15f856-94f2-43db-9420-ce3ac03272e7-ovn-node-metrics-cert\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb7b2256-9d00-45a5-9beb-203f649a7b03-dbus\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-var-lib-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-k8s-cni-cncf-io\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029196    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-run-netns\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-ovnkube-config\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdvh\" (UniqueName: \"kubernetes.io/projected/4d15f856-94f2-43db-9420-ce3ac03272e7-kube-api-access-4hdvh\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-host-slash\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-cni-bin\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-run\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-host\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.096980 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-tuned\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-log-socket\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-ovnkube-script-lib\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029555    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-cni-multus\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td49m\" (UniqueName: \"kubernetes.io/projected/5578e0c2-249d-41f5-916d-71c590d15a4e-kube-api-access-td49m\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-iptables-alerter-script\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a773485-54c9-40aa-8c58-e36909f69126-konnectivity-ca\") pod \"konnectivity-agent-x6l4g\" (UID: \"4a773485-54c9-40aa-8c58-e36909f69126\") " pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029685    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.029687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-cnibin\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.030217    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jfl\" (UniqueName: \"kubernetes.io/projected/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-kube-api-access-s5jfl\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.030248    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ab89a9b-52b3-46e9-a219-9a23779478dc-serviceca\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.030837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-cni-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.030875    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.030937    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.031302    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.031315    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.031438    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:01:16.097498 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.033158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.033731    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-26nbb\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.033807    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.033829    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r92vd\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.031850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.034106    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.034424    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.034683    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.037546    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.037690    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.037848    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bmwd9\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.038260    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.038464    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.038604    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gh8j\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.038607    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.040370    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.060812    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal" event={"ID":"2af57e46ea7583b75164ae638dc6a086","Type":"ContainerStarted","Data":"d8ded51cd1e530cf711076c27bbfe53dbc9639aa29912ec28c8d0e7ece28498f"}
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.060864    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal" event={"ID":"cb15ed011179ac858abbc3d152c7f014","Type":"ContainerStarted","Data":"394fb6a5e16cd9895ad9dd107aaa524f1a1fcf25a468cf2b2cd9bf3155470424"}
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.066079    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9tc7v"
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.071658    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9tc7v"
Jul 02 19:01:16.098128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.083064    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:01:16.131557 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-sys\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.131668 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-lib-modules\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.131668 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-systemd\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.131668 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-device-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-systemd\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f305ca40-f959-4dc4-a645-e3b3094d1d83-tmp\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131734    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-lib-modules\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5pf\" (UniqueName: \"kubernetes.io/projected/1ab89a9b-52b3-46e9-a219-9a23779478dc-kube-api-access-qk5pf\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-kubelet\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-netns\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131605    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-sys\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.131835 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131816    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-kubelet\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-daemon-config\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131883    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-systemd\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-var-lib-kubelet\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-hosts-file\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131939    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-tmp-dir\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.131988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-ovn\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-conf-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb7b2256-9d00-45a5-9beb-203f649a7b03-kubelet-config\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-modprobe-d\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132121    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-kubelet\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132180    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-netns\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysctl-conf\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.132370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-slash\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132227    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-env-overrides\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132297    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-var-lib-kubelet\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132353    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-systemd\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132402    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-hosts-file\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab8ca1a5-a051-4f14-9a79-8aea351b857e-cni-binary-copy\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-etc-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-ovn\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132468    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-tmp-dir\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-node-log\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132493    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-conf-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-cni-bin\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132515    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-node-log\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d15f856-94f2-43db-9420-ce3ac03272e7-ovn-node-metrics-cert\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132538    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cb7b2256-9d00-45a5-9beb-203f649a7b03-kubelet-config\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb7b2256-9d00-45a5-9beb-203f649a7b03-dbus\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-os-release\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132659    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysctl-conf\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwp9n\" (UniqueName: \"kubernetes.io/projected/845cc902-867e-4609-b84e-ec2e43491248-kube-api-access-mwp9n\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132730    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-slash\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-sys-fs\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-var-lib-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.133899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132887    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-socket-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-k8s-cni-cncf-io\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132927    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cb7b2256-9d00-45a5-9beb-203f649a7b03-dbus\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-run-netns\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.132985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-ovnkube-config\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdvh\" (UniqueName: \"kubernetes.io/projected/4d15f856-94f2-43db-9420-ce3ac03272e7-kube-api-access-4hdvh\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-host-slash\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-cni-bin\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133142    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-run\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-host\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-tuned\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133190    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-env-overrides\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-log-socket\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-ovnkube-script-lib\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.134608 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.133348    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.133426    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:01:16.63339506 +0000 UTC m=+3.251121142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-run-netns\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133614    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab8ca1a5-a051-4f14-9a79-8aea351b857e-cni-binary-copy\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133678    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-etc-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133730    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-var-lib-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133771    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-k8s-cni-cncf-io\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.133912    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-ovnkube-config\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134205    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-cni-bin\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134235    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-kubelet\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134607    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d15f856-94f2-43db-9420-ce3ac03272e7-ovnkube-script-lib\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134641    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-log-socket\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134664    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-host-slash\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.135359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-registration-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-daemon-config\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-cni-multus\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134816    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-modprobe-d\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134867    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-host\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134882    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-cni-bin\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td49m\" (UniqueName: \"kubernetes.io/projected/5578e0c2-249d-41f5-916d-71c590d15a4e-kube-api-access-td49m\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.134914    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-run\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-iptables-alerter-script\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a773485-54c9-40aa-8c58-e36909f69126-konnectivity-ca\") pod \"konnectivity-agent-x6l4g\" (UID: \"4a773485-54c9-40aa-8c58-e36909f69126\") " pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135109    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-var-lib-cni-multus\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-cnibin\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jfl\" (UniqueName: \"kubernetes.io/projected/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-kube-api-access-s5jfl\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ab89a9b-52b3-46e9-a219-9a23779478dc-serviceca\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.136162 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-cni-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-os-release\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-hostroot\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-multus-certs\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135546    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-cnibin\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ckjk\" (UniqueName: \"kubernetes.io/projected/ab8ca1a5-a051-4f14-9a79-8aea351b857e-kube-api-access-6ckjk\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135559    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-iptables-alerter-script\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm8fc\" (UniqueName: \"kubernetes.io/projected/f305ca40-f959-4dc4-a645-e3b3094d1d83-kube-api-access-mm8fc\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135608    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-os-release\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135631    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-host-run-multus-certs\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135649    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a773485-54c9-40aa-8c58-e36909f69126-konnectivity-ca\") pod \"konnectivity-agent-x6l4g\" (UID: \"4a773485-54c9-40aa-8c58-e36909f69126\") " pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135664    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-cni-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-hostroot\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-cni-netd\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135928    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2cjd\" (UniqueName: \"kubernetes.io/projected/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-kube-api-access-q2cjd\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.136810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jff7l\" (UniqueName: \"kubernetes.io/projected/5807ba73-a3e3-4c74-a914-198897dcae97-kube-api-access-jff7l\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135971    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-host-cni-netd\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.135989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-system-cni-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-etc-kubernetes\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136034    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ab89a9b-52b3-46e9-a219-9a23779478dc-serviceca\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136091    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-kubernetes\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysctl-d\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.136138    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ab89a9b-52b3-46e9-a219-9a23779478dc-host\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.136187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:16.636168834 +0000 UTC m=+3.253894892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136206    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ab89a9b-52b3-46e9-a219-9a23779478dc-host\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-systemd-units\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-socket-dir-parent\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136247    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-kubernetes\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137295 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136257    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-systemd-units\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysconfig\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136310    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-system-cni-dir\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136318    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-etc-kubernetes\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136320    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysconfig\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136352    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-tuned\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-system-cni-dir\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136382    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab8ca1a5-a051-4f14-9a79-8aea351b857e-multus-socket-dir-parent\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136398    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f305ca40-f959-4dc4-a645-e3b3094d1d83-tmp\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136421    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d15f856-94f2-43db-9420-ce3ac03272e7-run-openvswitch\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136425    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f305ca40-f959-4dc4-a645-e3b3094d1d83-etc-sysctl-d\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-cnibin\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a773485-54c9-40aa-8c58-e36909f69126-agent-certs\") pod \"konnectivity-agent-x6l4g\" (UID: \"4a773485-54c9-40aa-8c58-e36909f69126\") " pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.137750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.136955    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d15f856-94f2-43db-9420-ce3ac03272e7-ovn-node-metrics-cert\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.139158 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.139135    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a773485-54c9-40aa-8c58-e36909f69126-agent-certs\") pod \"konnectivity-agent-x6l4g\" (UID: \"4a773485-54c9-40aa-8c58-e36909f69126\") " pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.141750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.141723    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5pf\" (UniqueName: \"kubernetes.io/projected/1ab89a9b-52b3-46e9-a219-9a23779478dc-kube-api-access-qk5pf\") pod \"node-ca-xqdfw\" (UID: \"1ab89a9b-52b3-46e9-a219-9a23779478dc\") " pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.142473 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.142338    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:16.142473 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.142363    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:16.142473 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.142377    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:16.142473 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.142451    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:16.642433927 +0000 UTC m=+3.260160002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:16.143689 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.143630    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdvh\" (UniqueName: \"kubernetes.io/projected/4d15f856-94f2-43db-9420-ce3ac03272e7-kube-api-access-4hdvh\") pod \"ovnkube-node-gxj45\" (UID: \"4d15f856-94f2-43db-9420-ce3ac03272e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.144300 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.144276    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jfl\" (UniqueName: \"kubernetes.io/projected/a9fbd075-b1d2-4ed7-a5bf-05771c992f32-kube-api-access-s5jfl\") pod \"node-resolver-dhjtj\" (UID: \"a9fbd075-b1d2-4ed7-a5bf-05771c992f32\") " pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.144971 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.144947    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2cjd\" (UniqueName: \"kubernetes.io/projected/a6e71f65-865f-4cd5-89d8-d6f9dd91076f-kube-api-access-q2cjd\") pod \"iptables-alerter-hwlrt\" (UID: \"a6e71f65-865f-4cd5-89d8-d6f9dd91076f\") " pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.145246 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.145228    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ckjk\" (UniqueName: \"kubernetes.io/projected/ab8ca1a5-a051-4f14-9a79-8aea351b857e-kube-api-access-6ckjk\") pod \"multus-mllw2\" (UID: \"ab8ca1a5-a051-4f14-9a79-8aea351b857e\") " pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.145320 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.145307    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm8fc\" (UniqueName: \"kubernetes.io/projected/f305ca40-f959-4dc4-a645-e3b3094d1d83-kube-api-access-mm8fc\") pod \"tuned-l6qb7\" (UID: \"f305ca40-f959-4dc4-a645-e3b3094d1d83\") " pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.145875 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.145856    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td49m\" (UniqueName: \"kubernetes.io/projected/5578e0c2-249d-41f5-916d-71c590d15a4e-kube-api-access-td49m\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.236905 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.236867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237078 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.236924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-os-release\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237078 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.236949    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237314 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.236974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237428 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwp9n\" (UniqueName: \"kubernetes.io/projected/845cc902-867e-4609-b84e-ec2e43491248-kube-api-access-mwp9n\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237428 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.237428 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-sys-fs\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.237582 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-socket-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.237582 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.237679 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-registration-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.237679 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237661    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-os-release\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237778 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237731    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.237778 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237750    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-registration-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.238294 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.237986    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.238294 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238006    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-sys-fs\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.238294 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238063    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.238294 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238196    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-socket-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238626    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jff7l\" (UniqueName: \"kubernetes.io/projected/5807ba73-a3e3-4c74-a914-198897dcae97-kube-api-access-jff7l\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-system-cni-dir\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-cnibin\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-device-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238964    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5807ba73-a3e3-4c74-a914-198897dcae97-device-dir\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.238981    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.239025 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.239021    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-system-cni-dir\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.239507 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.239097    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/845cc902-867e-4609-b84e-ec2e43491248-cnibin\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.241224 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.239616    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/845cc902-867e-4609-b84e-ec2e43491248-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.246949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.246927    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwp9n\" (UniqueName: \"kubernetes.io/projected/845cc902-867e-4609-b84e-ec2e43491248-kube-api-access-mwp9n\") pod \"multus-additional-cni-plugins-lpzg4\" (UID: \"845cc902-867e-4609-b84e-ec2e43491248\") " pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.248345 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.248322    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jff7l\" (UniqueName: \"kubernetes.io/projected/5807ba73-a3e3-4c74-a914-198897dcae97-kube-api-access-jff7l\") pod \"aws-ebs-csi-driver-node-xgrn8\" (UID: \"5807ba73-a3e3-4c74-a914-198897dcae97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.256462 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.256441    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:01:16.331505 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.331474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqdfw"
Jul 02 19:01:16.350708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.350638    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mllw2"
Jul 02 19:01:16.355497 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.355459    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l6qb7"
Jul 02 19:01:16.362097 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.362077    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dhjtj"
Jul 02 19:01:16.394061 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.394043    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:16.405924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.405906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:16.415843 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.415823    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hwlrt"
Jul 02 19:01:16.421590 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.421573    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8"
Jul 02 19:01:16.426285 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.426264    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpzg4"
Jul 02 19:01:16.641339 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.641305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:16.641543 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.641372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:16.641543 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.641495    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:16.641672 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.641578    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:17.641556498 +0000 UTC m=+4.259282580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:16.641672 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.641500    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:16.641798 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.641756    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:01:17.64172981 +0000 UTC m=+4.259455882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:16.742822 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:16.742784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:16.743007 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.742982    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:16.743007 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.743005    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:16.743163 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.743019    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:16.743163 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:16.743115    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:17.743095741 +0000 UTC m=+4.360821814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:16.927079 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.927047    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5807ba73_a3e3_4c74_a914_198897dcae97.slice/crio-75cb0f9e7b71c9bf2ca3f4b4ddd80233d87fa36f1344761514c29400c941af99 WatchSource:0}: Error finding container 75cb0f9e7b71c9bf2ca3f4b4ddd80233d87fa36f1344761514c29400c941af99: Status 404 returned error can't find the container with id 75cb0f9e7b71c9bf2ca3f4b4ddd80233d87fa36f1344761514c29400c941af99
Jul 02 19:01:16.938772 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.938744    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845cc902_867e_4609_b84e_ec2e43491248.slice/crio-64f1300c9216d724ecf91d283d468cf8d4f1b6a6750d5990b080580618ec50f1 WatchSource:0}: Error finding container 64f1300c9216d724ecf91d283d468cf8d4f1b6a6750d5990b080580618ec50f1: Status 404 returned error can't find the container with id 64f1300c9216d724ecf91d283d468cf8d4f1b6a6750d5990b080580618ec50f1
Jul 02 19:01:16.943843 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.943779    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e71f65_865f_4cd5_89d8_d6f9dd91076f.slice/crio-2aaf1d3f50f2bfa1f48f338ab5bb1e5f1f1be9c5449524485e9138bcb5ecae08 WatchSource:0}: Error finding container 2aaf1d3f50f2bfa1f48f338ab5bb1e5f1f1be9c5449524485e9138bcb5ecae08: Status 404 returned error can't find the container with id 2aaf1d3f50f2bfa1f48f338ab5bb1e5f1f1be9c5449524485e9138bcb5ecae08
Jul 02 19:01:16.944870 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.944753    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a773485_54c9_40aa_8c58_e36909f69126.slice/crio-ef6d577c6e0bdf5bff9edc4ee7d52b6477a857872d9d04083387b08020c08bbd WatchSource:0}: Error finding container ef6d577c6e0bdf5bff9edc4ee7d52b6477a857872d9d04083387b08020c08bbd: Status 404 returned error can't find the container with id ef6d577c6e0bdf5bff9edc4ee7d52b6477a857872d9d04083387b08020c08bbd
Jul 02 19:01:16.946745 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.946120    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf305ca40_f959_4dc4_a645_e3b3094d1d83.slice/crio-0ae07e975778f0bb430869fd398bd2c58bb3855bb57104d44aaccb71b1325fe6 WatchSource:0}: Error finding container 0ae07e975778f0bb430869fd398bd2c58bb3855bb57104d44aaccb71b1325fe6: Status 404 returned error can't find the container with id 0ae07e975778f0bb430869fd398bd2c58bb3855bb57104d44aaccb71b1325fe6
Jul 02 19:01:16.947363 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.947340    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab89a9b_52b3_46e9_a219_9a23779478dc.slice/crio-a90ce5c70333250051ac16fb6404a4216023d2fa2b47070d85eb32db11c57d1b WatchSource:0}: Error finding container a90ce5c70333250051ac16fb6404a4216023d2fa2b47070d85eb32db11c57d1b: Status 404 returned error can't find the container with id a90ce5c70333250051ac16fb6404a4216023d2fa2b47070d85eb32db11c57d1b
Jul 02 19:01:16.949238 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.949087    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d15f856_94f2_43db_9420_ce3ac03272e7.slice/crio-c8f2cc21b7b18bed4f07f7b4f0049a8c8a4f415bc9b728cd99afa45e141d0982 WatchSource:0}: Error finding container c8f2cc21b7b18bed4f07f7b4f0049a8c8a4f415bc9b728cd99afa45e141d0982: Status 404 returned error can't find the container with id c8f2cc21b7b18bed4f07f7b4f0049a8c8a4f415bc9b728cd99afa45e141d0982
Jul 02 19:01:16.950254 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.950225    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8ca1a5_a051_4f14_9a79_8aea351b857e.slice/crio-76c74b09e2b49e8953a74a9b70a484d58981c14e9d1a50382bd2e16c9b9095eb WatchSource:0}: Error finding container 76c74b09e2b49e8953a74a9b70a484d58981c14e9d1a50382bd2e16c9b9095eb: Status 404 returned error can't find the container with id 76c74b09e2b49e8953a74a9b70a484d58981c14e9d1a50382bd2e16c9b9095eb
Jul 02 19:01:16.951559 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:16.951441    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fbd075_b1d2_4ed7_a5bf_05771c992f32.slice/crio-a3bd9b4951b284ba3d625a279cdd05b56fe89c7f210e55e213f4bdacca9600af WatchSource:0}: Error finding container a3bd9b4951b284ba3d625a279cdd05b56fe89c7f210e55e213f4bdacca9600af: Status 404 returned error can't find the container with id a3bd9b4951b284ba3d625a279cdd05b56fe89c7f210e55e213f4bdacca9600af
Jul 02 19:01:17.064111 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.064069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mllw2" event={"ID":"ab8ca1a5-a051-4f14-9a79-8aea351b857e","Type":"ContainerStarted","Data":"76c74b09e2b49e8953a74a9b70a484d58981c14e9d1a50382bd2e16c9b9095eb"}
Jul 02 19:01:17.065490 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.065458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"c8f2cc21b7b18bed4f07f7b4f0049a8c8a4f415bc9b728cd99afa45e141d0982"}
Jul 02 19:01:17.066767 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.066742    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l6qb7" event={"ID":"f305ca40-f959-4dc4-a645-e3b3094d1d83","Type":"ContainerStarted","Data":"0ae07e975778f0bb430869fd398bd2c58bb3855bb57104d44aaccb71b1325fe6"}
Jul 02 19:01:17.068216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.068173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6l4g" event={"ID":"4a773485-54c9-40aa-8c58-e36909f69126","Type":"ContainerStarted","Data":"ef6d577c6e0bdf5bff9edc4ee7d52b6477a857872d9d04083387b08020c08bbd"}
Jul 02 19:01:17.069519 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.069490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwlrt" event={"ID":"a6e71f65-865f-4cd5-89d8-d6f9dd91076f","Type":"ContainerStarted","Data":"2aaf1d3f50f2bfa1f48f338ab5bb1e5f1f1be9c5449524485e9138bcb5ecae08"}
Jul 02 19:01:17.070856 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.070830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dhjtj" event={"ID":"a9fbd075-b1d2-4ed7-a5bf-05771c992f32","Type":"ContainerStarted","Data":"a3bd9b4951b284ba3d625a279cdd05b56fe89c7f210e55e213f4bdacca9600af"}
Jul 02 19:01:17.072336 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.072310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqdfw" event={"ID":"1ab89a9b-52b3-46e9-a219-9a23779478dc","Type":"ContainerStarted","Data":"a90ce5c70333250051ac16fb6404a4216023d2fa2b47070d85eb32db11c57d1b"}
Jul 02 19:01:17.073501 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.073460    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:56:16 +0000 UTC" deadline="2028-02-26 21:37:28.879051168 +0000 UTC"
Jul 02 19:01:17.073501 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.073492    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14498h36m11.805563211s"
Jul 02 19:01:17.073660 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.073523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerStarted","Data":"64f1300c9216d724ecf91d283d468cf8d4f1b6a6750d5990b080580618ec50f1"}
Jul 02 19:01:17.074834 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.074808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8" event={"ID":"5807ba73-a3e3-4c74-a914-198897dcae97","Type":"ContainerStarted","Data":"75cb0f9e7b71c9bf2ca3f4b4ddd80233d87fa36f1344761514c29400c941af99"}
Jul 02 19:01:17.076896 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.076876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal" event={"ID":"cb15ed011179ac858abbc3d152c7f014","Type":"ContainerStarted","Data":"2bff62fa7a39c726ce522c3af67b0670ea22f1e3719631ce48458ae9ff03f523"}
Jul 02 19:01:17.092554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.092506    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.ec2.internal" podStartSLOduration=2.092492559 podStartE2EDuration="2.092492559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:17.092298385 +0000 UTC m=+3.710024467" watchObservedRunningTime="2026-07-02 19:01:17.092492559 +0000 UTC m=+3.710218640"
Jul 02 19:01:17.651923 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.650789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:17.651923 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.651127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:17.651923 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.651324    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:17.651923 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.651404    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:01:19.651373948 +0000 UTC m=+6.269100014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:17.651923 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.651828    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:17.651923 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.651882    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:19.651863805 +0000 UTC m=+6.269589881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:17.752145 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.752104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:17.752340 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.752276    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:17.752340 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.752296    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:17.752340 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.752309    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:17.752495 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.752369    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:19.752350097 +0000 UTC m=+6.370076173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:17.936644 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.936529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:17.936803 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.936671    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:17.937149 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.937126    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:17.937259 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.937240    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:17.937333 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:17.937310    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:17.937419 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:17.937401    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:18.074787 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:18.074740    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:56:16 +0000 UTC" deadline="2028-03-08 00:55:27.217097567 +0000 UTC"
Jul 02 19:01:18.074787 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:18.074784    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14741h54m9.142318203s"
Jul 02 19:01:19.671005 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:19.670193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:19.671005 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:19.670260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:19.671005 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.670390    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:19.671005 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.670452    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:01:23.670431714 +0000 UTC m=+10.288157779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:19.671005 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.670863    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:19.671005 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.670917    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:23.670900992 +0000 UTC m=+10.288627055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:19.771826 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:19.771195    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:19.771826 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.771380    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:19.771826 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.771399    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:19.771826 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.771412    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:19.771826 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.771477    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:23.771458125 +0000 UTC m=+10.389184191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:19.936190 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:19.935277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:19.936190 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.935412    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:19.936190 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:19.935821    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:19.936190 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.935957    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:19.936190 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:19.936033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:19.936693 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:19.936639    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:20.092516 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:20.092427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal" event={"ID":"2af57e46ea7583b75164ae638dc6a086","Type":"ContainerStarted","Data":"c4aa97edb960b6c61822760450701adddbb7dda24dda6ec58a8585e77d5e4f88"}
Jul 02 19:01:21.934539 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:21.934503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:21.935002 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:21.934650    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:21.935002 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:21.934507    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:21.935002 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:21.934701    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:21.935002 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:21.934804    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:21.935002 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:21.934894    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:23.707044 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:23.707001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:23.707551 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:23.707094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:23.707551 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.707241    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:23.707551 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.707313    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:01:31.707291288 +0000 UTC m=+18.325017368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:23.707551 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.707388    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:23.707551 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.707424    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:31.707412381 +0000 UTC m=+18.325138441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:23.808516 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:23.808430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:23.808696 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.808616    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:23.808696 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.808641    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:23.808696 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.808655    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:23.808858 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.808729    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:31.808706844 +0000 UTC m=+18.426432923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:23.934892 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:23.934856    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:23.935060 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.934976    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:23.935060 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:23.935045    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:23.935189 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.935137    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:23.935544 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:23.935519    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:23.935654 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:23.935638    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:24.102992 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:24.102907    2567 generic.go:356] "Generic (PLEG): container finished" podID="2af57e46ea7583b75164ae638dc6a086" containerID="c4aa97edb960b6c61822760450701adddbb7dda24dda6ec58a8585e77d5e4f88" exitCode=0
Jul 02 19:01:24.102992 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:24.102965    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal" event={"ID":"2af57e46ea7583b75164ae638dc6a086","Type":"ContainerDied","Data":"c4aa97edb960b6c61822760450701adddbb7dda24dda6ec58a8585e77d5e4f88"}
Jul 02 19:01:25.934836 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:25.934799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:25.934836 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:25.934832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:25.935393 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:25.934799    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:25.935393 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:25.934973    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:25.935393 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:25.934991    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:25.935393 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:25.935085    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:27.934489 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:27.934455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:27.934898 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:27.934455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:27.934898 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:27.934569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:27.934898 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:27.934652    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:27.934898 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:27.934467    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:27.934898 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:27.934745    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:29.934790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:29.934753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:29.934790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:29.934783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:29.935321 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:29.934753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:29.935321 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:29.934877    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:29.935321 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:29.934923    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:29.935321 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:29.935003    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:31.768254 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:31.768227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:31.768606 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:31.768269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:31.768606 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.768369    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:31.768606 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.768373    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:31.768606 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.768433    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:01:47.768415993 +0000 UTC m=+34.386142050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:31.768606 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.768447    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:47.768440895 +0000 UTC m=+34.386166950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:31.869436 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:31.869406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:31.869592 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.869574    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:31.869630 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.869600    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:31.869630 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.869614    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:31.869688 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.869666    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:47.869652545 +0000 UTC m=+34.487378606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:31.934842 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:31.934811    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:31.934842 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:31.934830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:31.935099 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:31.934811    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:31.935099 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.934949    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:31.935198 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.935105    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:31.935198 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:31.935188    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:33.934853 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:33.934814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:33.935300 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:33.934932    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:33.935300 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:33.934932    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:33.935300 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:33.935059    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:33.935300 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:33.935087    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:33.935300 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:33.935142    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:35.934790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:35.934749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:35.934790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:35.934768    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:35.935303 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:35.934913    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:35.935303 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:35.935029    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:35.935303 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:35.935087    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:35.935303 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:35.935167    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:37.130625 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.130254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l6qb7" event={"ID":"f305ca40-f959-4dc4-a645-e3b3094d1d83","Type":"ContainerStarted","Data":"794c550d243f94a9f5db86d50be117e5b1386e94748b0fefda0d4a09917366d1"}
Jul 02 19:01:37.131804 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.131775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x6l4g" event={"ID":"4a773485-54c9-40aa-8c58-e36909f69126","Type":"ContainerStarted","Data":"36b6c41cec2e545f4de7e0457ba5a9c98260c5324f9e3eb9fd732be20c26c810"}
Jul 02 19:01:37.133354 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.133319    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dhjtj" event={"ID":"a9fbd075-b1d2-4ed7-a5bf-05771c992f32","Type":"ContainerStarted","Data":"cbc082599c2e20766032eb0afebe36cd79c49518fe39324c844ff2ccb77ae4b1"}
Jul 02 19:01:37.134849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.134824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqdfw" event={"ID":"1ab89a9b-52b3-46e9-a219-9a23779478dc","Type":"ContainerStarted","Data":"072f736a740f9e5892d2f7eb5110b10fdf39c6ff6bf750677385806eba476a61"}
Jul 02 19:01:37.136160 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.136138    2567 generic.go:356] "Generic (PLEG): container finished" podID="845cc902-867e-4609-b84e-ec2e43491248" containerID="883415f8277b97983d9172e80a51b2d695650244a2bef68f4b13ef4a934f62c1" exitCode=0
Jul 02 19:01:37.136243 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.136216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerDied","Data":"883415f8277b97983d9172e80a51b2d695650244a2bef68f4b13ef4a934f62c1"}
Jul 02 19:01:37.137680 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.137657    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8" event={"ID":"5807ba73-a3e3-4c74-a914-198897dcae97","Type":"ContainerStarted","Data":"2d74f7a9842722aa1e3a613a97cb5aacc42b21771afb763b8257459ccd731019"}
Jul 02 19:01:37.139287 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.139268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal" event={"ID":"2af57e46ea7583b75164ae638dc6a086","Type":"ContainerStarted","Data":"fac9d2d175b0f2b6fae5c0f0b3d9190a29071cd8625398f06f85d9059cdf967f"}
Jul 02 19:01:37.140715 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.140690    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mllw2" event={"ID":"ab8ca1a5-a051-4f14-9a79-8aea351b857e","Type":"ContainerStarted","Data":"aed6e685f878af6eddde0b7ec462ec320770e7d80d1bb3f26fd61c88e773d89b"}
Jul 02 19:01:37.143579 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.143564    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:01:37.143894 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.143873    2567 generic.go:356] "Generic (PLEG): container finished" podID="4d15f856-94f2-43db-9420-ce3ac03272e7" containerID="f4414e873f401b4cc8cd1901062ac8cf365571525d14226ad70839c7747bdfd6" exitCode=1
Jul 02 19:01:37.144089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.143908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"5239b367db8a1e4637f36f4bbe94a05d8fcc93ad59ba1dea4b2dacac5dd29e46"}
Jul 02 19:01:37.144089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.143974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"5fe9934b9aa20c8df863fa401b2211fe36eafef6fec41280c5346a716bf7af4d"}
Jul 02 19:01:37.144089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.144046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"754fd088d566c0848a0015b0c60792fcc31575deb076225f884ce7d0e17599ab"}
Jul 02 19:01:37.144203 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.144095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"e7966351ba150199f393f9a09f2dc7512ef65e2e52cdc5f422cb9071671797e5"}
Jul 02 19:01:37.144203 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.144141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerDied","Data":"f4414e873f401b4cc8cd1901062ac8cf365571525d14226ad70839c7747bdfd6"}
Jul 02 19:01:37.144272 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.144203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"c93075d9677896ac53c9de2939bdf36d8cace4e346469e134c0a8f72d235719b"}
Jul 02 19:01:37.146896 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.146855    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l6qb7" podStartSLOduration=4.098544158 podStartE2EDuration="23.146844266s" totalImagesPullingTime="19.048300108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:37.146777286 +0000 UTC m=+23.764503368" watchObservedRunningTime="2026-07-02 19:01:37.146844266 +0000 UTC m=+23.764570344"
Jul 02 19:01:37.161185 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.161154    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dhjtj" podStartSLOduration=4.124714244 podStartE2EDuration="23.161138931s" totalImagesPullingTime="19.036424687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:37.160642896 +0000 UTC m=+23.778368976" watchObservedRunningTime="2026-07-02 19:01:37.161138931 +0000 UTC m=+23.778865010"
Jul 02 19:01:37.198886 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.198842    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.ec2.internal" podStartSLOduration=22.198826169 podStartE2EDuration="22.198826169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:37.198303707 +0000 UTC m=+23.816029786" watchObservedRunningTime="2026-07-02 19:01:37.198826169 +0000 UTC m=+23.816552248"
Jul 02 19:01:37.229985 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.229925    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqdfw" podStartSLOduration=4.196034376 podStartE2EDuration="23.229904553s" totalImagesPullingTime="19.033870177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:37.229300403 +0000 UTC m=+23.847026482" watchObservedRunningTime="2026-07-02 19:01:37.229904553 +0000 UTC m=+23.847630636"
Jul 02 19:01:37.230284 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.230238    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x6l4g" podStartSLOduration=8.443033449 podStartE2EDuration="23.230228274s" totalImagesPullingTime="14.787194825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:37.215424623 +0000 UTC m=+23.833150693" watchObservedRunningTime="2026-07-02 19:01:37.230228274 +0000 UTC m=+23.847954353"
Jul 02 19:01:37.246854 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.246804    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mllw2" podStartSLOduration=4.166224259 podStartE2EDuration="23.246786001s" totalImagesPullingTime="19.080561742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:37.24644817 +0000 UTC m=+23.864174260" watchObservedRunningTime="2026-07-02 19:01:37.246786001 +0000 UTC m=+23.864512080"
Jul 02 19:01:37.671362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.671336    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:01:37.925410 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.925311    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:01:37.671356728Z","UUID":"4c1df955-01d0-4d11-a9f6-91b9bc65fce9","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:01:37.927092 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.927069    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:01:37.927224 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.927108    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:01:37.934510 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.934490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:37.934510 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.934505    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:37.934674 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:37.934493    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:37.934674 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:37.934595    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:37.934759 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:37.934703    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:37.934803 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:37.934784    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:38.148484 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:38.148449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hwlrt" event={"ID":"a6e71f65-865f-4cd5-89d8-d6f9dd91076f","Type":"ContainerStarted","Data":"4c3dc1168ca8af1d4633676dfaef8eeba1687a33c13a3f4720a5b73190b1ae08"}
Jul 02 19:01:38.150481 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:38.150448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8" event={"ID":"5807ba73-a3e3-4c74-a914-198897dcae97","Type":"ContainerStarted","Data":"5e206ec214f6d8a65c969a7203a9fdebda192b21c9917da7faf51c43d4abc7a5"}
Jul 02 19:01:38.166044 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:38.165841    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hwlrt" podStartSLOduration=5.12845179 podStartE2EDuration="24.16582162s" totalImagesPullingTime="19.03736983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:38.165472224 +0000 UTC m=+24.783198302" watchObservedRunningTime="2026-07-02 19:01:38.16582162 +0000 UTC m=+24.783547700"
Jul 02 19:01:39.934129 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:39.933932    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:39.934671 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:39.933936    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:39.934671 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:39.934203    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:39.934671 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:39.933999    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:39.934671 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:39.934286    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:39.934671 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:39.934351    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:40.157653 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:40.157626    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:01:40.157983 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:40.157957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"f06fdb1f186ecdbd78db600d60e21ac7f6457b9879bedfb239aa630ce800648c"}
Jul 02 19:01:40.159590 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:40.159569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8" event={"ID":"5807ba73-a3e3-4c74-a914-198897dcae97","Type":"ContainerStarted","Data":"b2463b7e37efc58f5295cd524a5b3e6596917cbdcb7bd09954d94ed9be16bb3b"}
Jul 02 19:01:40.774470 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:40.774439    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:41.387159 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:41.387108    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:41.387766 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:41.387747    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:41.402517 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:41.402469    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgrn8" podStartSLOduration=5.406469868 podStartE2EDuration="27.402446693s" totalImagesPullingTime="21.995976825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:40.179322137 +0000 UTC m=+26.797048238" watchObservedRunningTime="2026-07-02 19:01:41.402446693 +0000 UTC m=+28.020172772"
Jul 02 19:01:41.933916 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:41.933894    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:41.933982 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:41.933920    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:41.934313 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:41.934026    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:41.934313 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:41.934106    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:41.934313 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:41.934137    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:41.934313 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:41.934228    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:42.166988 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:42.166829    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:01:42.167331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:42.167309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"26c5e6b0011201aa9bb1220034461b3e52651759f31a4af8a6f589fc6fe48c57"}
Jul 02 19:01:42.171490 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:42.171435    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:42.171654 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:42.171634    2567 scope.go:117] "RemoveContainer" containerID="f4414e873f401b4cc8cd1901062ac8cf365571525d14226ad70839c7747bdfd6"
Jul 02 19:01:42.171919 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:42.171902    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x6l4g"
Jul 02 19:01:43.174986 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.174961    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:01:43.176342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.176305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" event={"ID":"4d15f856-94f2-43db-9420-ce3ac03272e7","Type":"ContainerStarted","Data":"31cbd1fe4f0af14d1330b78badaa0f70dd43b13f309f1cc62a142c328dfa727f"}
Jul 02 19:01:43.177967 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.177931    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:43.178102 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.178040    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:43.181281 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.180259    2567 generic.go:356] "Generic (PLEG): container finished" podID="845cc902-867e-4609-b84e-ec2e43491248" containerID="3cc621ab61a66064a3aaceeeb9c2e262fbc538b877cb8e9a210f07837c2e2775" exitCode=0
Jul 02 19:01:43.181281 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.181223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerDied","Data":"3cc621ab61a66064a3aaceeeb9c2e262fbc538b877cb8e9a210f07837c2e2775"}
Jul 02 19:01:43.204160 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.204135    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:43.206130 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.206093    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:01:43.207938 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.207882    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45" podStartSLOduration=9.638394129 podStartE2EDuration="29.207865811s" totalImagesPullingTime="19.569471682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:43.205670004 +0000 UTC m=+29.823396083" watchObservedRunningTime="2026-07-02 19:01:43.207865811 +0000 UTC m=+29.825591890"
Jul 02 19:01:43.935841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.935809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:43.936001 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.935913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:43.936001 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:43.935931    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:43.936001 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:43.935965    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:43.936118 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:43.936045    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:43.936118 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:43.936090    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:44.232571 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:44.232483    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntq7g"]
Jul 02 19:01:44.232989 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:44.232590    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:44.232989 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:44.232682    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:44.233278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:44.233256    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7j9f"]
Jul 02 19:01:44.233361 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:44.233351    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:44.233463 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:44.233447    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:44.243934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:44.243914    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76nvm"]
Jul 02 19:01:44.244048 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:44.243998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:44.244126 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:44.244105    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:45.186396 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:45.186148    2567 generic.go:356] "Generic (PLEG): container finished" podID="845cc902-867e-4609-b84e-ec2e43491248" containerID="9af3e3af65ede61d8b97bfdc6b7ddc79e9bee7669c2cddd6aab5c0adb5498c73" exitCode=0
Jul 02 19:01:45.186560 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:45.186225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerDied","Data":"9af3e3af65ede61d8b97bfdc6b7ddc79e9bee7669c2cddd6aab5c0adb5498c73"}
Jul 02 19:01:45.933963 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:45.933936    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:45.933963 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:45.933949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:45.934465 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:45.934100    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:45.934465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:45.934158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:45.934465 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:45.934247    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:45.934465 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:45.934327    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:47.193249 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.193215    2567 generic.go:356] "Generic (PLEG): container finished" podID="845cc902-867e-4609-b84e-ec2e43491248" containerID="97ff593a183edd6e4ac87656d87176d400483870b2d2c4c8c82960633e8e86cd" exitCode=0
Jul 02 19:01:47.194052 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.193277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerDied","Data":"97ff593a183edd6e4ac87656d87176d400483870b2d2c4c8c82960633e8e86cd"}
Jul 02 19:01:47.790222 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.790184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:47.790392 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.790235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:47.790392 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.790345    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:47.790392 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.790357    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:47.790488 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.790413    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret podName:cb7b2256-9d00-45a5-9beb-203f649a7b03 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.790397942 +0000 UTC m=+66.408124001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret") pod "global-pull-secret-syncer-ntq7g" (UID: "cb7b2256-9d00-45a5-9beb-203f649a7b03") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:01:47.790488 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.790428    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.790422681 +0000 UTC m=+66.408148737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:01:47.891384 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.891346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:47.891535 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.891475    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:01:47.891535 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.891490    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:01:47.891535 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.891500    2567 projected.go:196] Error preparing data for projected volume kube-api-access-ggn7b for pod openshift-network-diagnostics/network-check-target-76nvm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:47.891644 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.891544    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b podName:a2ee6208-7d73-41de-820a-410048d06a77 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:19.89153161 +0000 UTC m=+66.509257666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggn7b" (UniqueName: "kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b") pod "network-check-target-76nvm" (UID: "a2ee6208-7d73-41de-820a-410048d06a77") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:01:47.934571 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.934539    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:47.934730 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.934585    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:47.934730 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:47.934542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:47.934730 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.934663    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntq7g" podUID="cb7b2256-9d00-45a5-9beb-203f649a7b03"
Jul 02 19:01:47.934895 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.934763    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76nvm" podUID="a2ee6208-7d73-41de-820a-410048d06a77"
Jul 02 19:01:47.934895 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:47.934877    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:01:48.720301 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.720273    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-37.ec2.internal" event="NodeReady"
Jul 02 19:01:48.720727 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.720431    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:01:48.768211 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.768173    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r884g"]
Jul 02 19:01:48.770394 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.770371    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4lzs4"]
Jul 02 19:01:48.770534 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.770515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.772171 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.772107    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:48.772954 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.772923    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:01:48.773114 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.772958    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2dxc\""
Jul 02 19:01:48.773114 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.773035    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:01:48.774289 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.774220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:01:48.774692 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.774618    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:01:48.774778 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.774716    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:01:48.774778 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.774620    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntzvv\""
Jul 02 19:01:48.780058 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.779190    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lzs4"]
Jul 02 19:01:48.782384 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.782363    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r884g"]
Jul 02 19:01:48.797519 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.797500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-config-volume\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.797635 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.797524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/435b3531-7335-491b-bc65-8a959f46ac74-cert\") pod \"ingress-canary-4lzs4\" (UID: \"435b3531-7335-491b-bc65-8a959f46ac74\") " pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:48.797635 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.797553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-tmp-dir\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.797635 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.797583    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.797790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.797640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48jn\" (UniqueName: \"kubernetes.io/projected/435b3531-7335-491b-bc65-8a959f46ac74-kube-api-access-s48jn\") pod \"ingress-canary-4lzs4\" (UID: \"435b3531-7335-491b-bc65-8a959f46ac74\") " pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:48.797790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.797711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj5t7\" (UniqueName: \"kubernetes.io/projected/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-kube-api-access-tj5t7\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.897996 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.897960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-tmp-dir\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.898176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.898176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s48jn\" (UniqueName: \"kubernetes.io/projected/435b3531-7335-491b-bc65-8a959f46ac74-kube-api-access-s48jn\") pod \"ingress-canary-4lzs4\" (UID: \"435b3531-7335-491b-bc65-8a959f46ac74\") " pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:48.898176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj5t7\" (UniqueName: \"kubernetes.io/projected/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-kube-api-access-tj5t7\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.898176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-config-volume\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.898176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/435b3531-7335-491b-bc65-8a959f46ac74-cert\") pod \"ingress-canary-4lzs4\" (UID: \"435b3531-7335-491b-bc65-8a959f46ac74\") " pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:48.898419 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:48.898189    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:01:48.898419 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:48.898251    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:49.398231738 +0000 UTC m=+36.015957810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:01:48.898526 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898443    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-tmp-dir\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.898839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.898818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-config-volume\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.902889 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.902867    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/435b3531-7335-491b-bc65-8a959f46ac74-cert\") pod \"ingress-canary-4lzs4\" (UID: \"435b3531-7335-491b-bc65-8a959f46ac74\") " pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:48.907102 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.907047    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj5t7\" (UniqueName: \"kubernetes.io/projected/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-kube-api-access-tj5t7\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:48.907675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:48.907653    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48jn\" (UniqueName: \"kubernetes.io/projected/435b3531-7335-491b-bc65-8a959f46ac74-kube-api-access-s48jn\") pod \"ingress-canary-4lzs4\" (UID: \"435b3531-7335-491b-bc65-8a959f46ac74\") " pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:49.091139 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.091090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lzs4"
Jul 02 19:01:49.237244 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.236887    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lzs4"]
Jul 02 19:01:49.240228 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:01:49.240202    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435b3531_7335_491b_bc65_8a959f46ac74.slice/crio-d5105e374bbe8b7c17bfa2ba045e1c54b67e979593620d7abae517efa4f2aad7 WatchSource:0}: Error finding container d5105e374bbe8b7c17bfa2ba045e1c54b67e979593620d7abae517efa4f2aad7: Status 404 returned error can't find the container with id d5105e374bbe8b7c17bfa2ba045e1c54b67e979593620d7abae517efa4f2aad7
Jul 02 19:01:49.401577 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.401532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:49.401734 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:49.401658    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:01:49.401734 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:49.401721    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:50.40170548 +0000 UTC m=+37.019431555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:01:49.934024 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.933979    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:01:49.934554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.933983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:01:49.934554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.933983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:01:49.936810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.936787    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:01:49.936810 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.936787    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:01:49.937720 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.937704    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:01:49.937798 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.937764    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:01:49.937847 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.937795    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h66dc\""
Jul 02 19:01:49.937847 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:49.937806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5znl7\""
Jul 02 19:01:50.201852 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:50.201771    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lzs4" event={"ID":"435b3531-7335-491b-bc65-8a959f46ac74","Type":"ContainerStarted","Data":"d5105e374bbe8b7c17bfa2ba045e1c54b67e979593620d7abae517efa4f2aad7"}
Jul 02 19:01:50.408527 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:50.408465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:50.408730 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:50.408594    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:01:50.408730 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:50.408665    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:52.408645476 +0000 UTC m=+39.026371555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:01:52.422216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:52.422189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:52.422492 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:52.422295    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:01:52.422492 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:52.422350    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:01:56.422334496 +0000 UTC m=+43.040060554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:01:53.210753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:53.210723    2567 generic.go:356] "Generic (PLEG): container finished" podID="845cc902-867e-4609-b84e-ec2e43491248" containerID="bdc97d63d9385548b33f41a7b716e9c8dcf5bafa4721383f054c70a045575b23" exitCode=0
Jul 02 19:01:53.210882 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:53.210763    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerDied","Data":"bdc97d63d9385548b33f41a7b716e9c8dcf5bafa4721383f054c70a045575b23"}
Jul 02 19:01:54.214390 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:54.214350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lzs4" event={"ID":"435b3531-7335-491b-bc65-8a959f46ac74","Type":"ContainerStarted","Data":"c9a25c1f39df8ea105139e373f4d9b025dbef79d2c90068726e55562997ef5a9"}
Jul 02 19:01:54.217173 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:54.217145    2567 generic.go:356] "Generic (PLEG): container finished" podID="845cc902-867e-4609-b84e-ec2e43491248" containerID="ea918aa8c7dcc59de5d35f4cf45fa4bcb1fb5068842fe0e698770db2e246c3f5" exitCode=0
Jul 02 19:01:54.217283 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:54.217181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerDied","Data":"ea918aa8c7dcc59de5d35f4cf45fa4bcb1fb5068842fe0e698770db2e246c3f5"}
Jul 02 19:01:54.229280 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:54.229241    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4lzs4" podStartSLOduration=2.07209952 podStartE2EDuration="6.229227592s" totalImagesPullingTime="4.157128072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:54.228561332 +0000 UTC m=+40.846287407" watchObservedRunningTime="2026-07-02 19:01:54.229227592 +0000 UTC m=+40.846953670"
Jul 02 19:01:55.222945 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:55.222908    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" event={"ID":"845cc902-867e-4609-b84e-ec2e43491248","Type":"ContainerStarted","Data":"4fc5a423bca9f23908814832f9cf7e083fbdd618909e4def9bf756e4ccb393fe"}
Jul 02 19:01:55.248554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:55.248516    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lpzg4" podStartSLOduration=9.808246736 podStartE2EDuration="41.2485025s" totalImagesPullingTime="31.440255764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:01:55.247295221 +0000 UTC m=+41.865021300" watchObservedRunningTime="2026-07-02 19:01:55.2485025 +0000 UTC m=+41.866228578"
Jul 02 19:01:56.452866 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:01:56.452834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:01:56.453259 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:56.452966    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:01:56.453259 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:01:56.453039    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:04.453007416 +0000 UTC m=+51.070733489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:04.508420 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:04.508379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:02:04.508868 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:04.508529    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:04.508868 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:04.508602    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:20.508587338 +0000 UTC m=+67.126313394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:15.199991 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:15.199961    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxj45"
Jul 02 19:02:19.814899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.814849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:02:19.814899 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.814911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:02:19.818587 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.818566    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:02:19.818659 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.818573    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:02:19.825685 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:19.825665    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:02:19.825746 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:19.825734    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:03:23.825714859 +0000 UTC m=+130.443440922 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : secret "metrics-daemon-secret" not found
Jul 02 19:02:19.829066 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.829047    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cb7b2256-9d00-45a5-9beb-203f649a7b03-original-pull-secret\") pod \"global-pull-secret-syncer-ntq7g\" (UID: \"cb7b2256-9d00-45a5-9beb-203f649a7b03\") " pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:02:19.915983 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.915929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:02:19.920719 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.920697    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:02:19.929793 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.929769    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:02:19.939218 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.939192    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggn7b\" (UniqueName: \"kubernetes.io/projected/a2ee6208-7d73-41de-820a-410048d06a77-kube-api-access-ggn7b\") pod \"network-check-target-76nvm\" (UID: \"a2ee6208-7d73-41de-820a-410048d06a77\") " pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:02:19.954511 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.954491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5znl7\""
Jul 02 19:02:19.956614 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.956599    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntq7g"
Jul 02 19:02:19.961422 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:19.961402    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:02:20.084082 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:20.083922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntq7g"]
Jul 02 19:02:20.103412 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:20.103289    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76nvm"]
Jul 02 19:02:20.110540 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:02:20.110512    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ee6208_7d73_41de_820a_410048d06a77.slice/crio-9237a3a0c91f76c1e3056d9d09cd11c4f41cfaedf826dd3f4f9fa307df703cb7 WatchSource:0}: Error finding container 9237a3a0c91f76c1e3056d9d09cd11c4f41cfaedf826dd3f4f9fa307df703cb7: Status 404 returned error can't find the container with id 9237a3a0c91f76c1e3056d9d09cd11c4f41cfaedf826dd3f4f9fa307df703cb7
Jul 02 19:02:20.279423 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:20.279383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76nvm" event={"ID":"a2ee6208-7d73-41de-820a-410048d06a77","Type":"ContainerStarted","Data":"9237a3a0c91f76c1e3056d9d09cd11c4f41cfaedf826dd3f4f9fa307df703cb7"}
Jul 02 19:02:20.280394 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:20.280370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntq7g" event={"ID":"cb7b2256-9d00-45a5-9beb-203f649a7b03","Type":"ContainerStarted","Data":"45943b28fc02e16ba4ff8771e0c61b4683794ce8b3365c35811afb449f84bf14"}
Jul 02 19:02:20.520280 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:20.520248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:02:20.520437 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:20.520366    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:20.520437 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:20.520417    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:02:52.520403275 +0000 UTC m=+99.138129330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:25.295342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:25.295297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76nvm" event={"ID":"a2ee6208-7d73-41de-820a-410048d06a77","Type":"ContainerStarted","Data":"b1fddf16d74e4fe3ae4f319f27df4a2cc0f1ed770aa8ce3e0bf7d13ff90efa36"}
Jul 02 19:02:25.295764 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:25.295459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:02:25.296750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:25.296725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntq7g" event={"ID":"cb7b2256-9d00-45a5-9beb-203f649a7b03","Type":"ContainerStarted","Data":"32fa85a5b4eed3eed4d977dc5d6d8674c8727f0d008564b1b26c210f548c4ba4"}
Jul 02 19:02:25.312130 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:25.312090    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-76nvm" podStartSLOduration=66.831755681 podStartE2EDuration="1m11.312076111s" totalImagesPullingTime="4.48032043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:25.311547773 +0000 UTC m=+71.929273852" watchObservedRunningTime="2026-07-02 19:02:25.312076111 +0000 UTC m=+71.929802188"
Jul 02 19:02:25.325640 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:25.325598    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ntq7g" podStartSLOduration=66.819820441 podStartE2EDuration="1m11.325586472s" totalImagesPullingTime="4.505766031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:02:25.325199562 +0000 UTC m=+71.942925651" watchObservedRunningTime="2026-07-02 19:02:25.325586472 +0000 UTC m=+71.943312544"
Jul 02 19:02:52.538784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:52.538668    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:02:52.539239 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:52.538828    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:02:52.539239 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:02:52.538900    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:56.5388819 +0000 UTC m=+163.156607956 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:02:56.302203 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:02:56.302175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-76nvm"
Jul 02 19:03:23.840685 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:03:23.840646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:03:23.841278 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:03:23.840822    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:03:23.841278 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:03:23.840906    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:05:25.840884497 +0000 UTC m=+252.458610553 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : secret "metrics-daemon-secret" not found
Jul 02 19:03:51.784441 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:03:51.784398    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r884g" podUID="37ebe3ab-fdd1-46b7-aa44-be602d2cdb93"
Jul 02 19:03:52.501342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:03:52.501311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r884g"
Jul 02 19:03:52.944408 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:03:52.944368    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:03:56.561187 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:03:56.561151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:03:56.561610 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:03:56.561297    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:56.561610 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:03:56.561359    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls podName:37ebe3ab-fdd1-46b7-aa44-be602d2cdb93 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:58.561342864 +0000 UTC m=+285.179068920 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls") pod "dns-default-r884g" (UID: "37ebe3ab-fdd1-46b7-aa44-be602d2cdb93") : secret "dns-default-metrics-tls" not found
Jul 02 19:04:05.934246 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:04:05.934211    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:05:25.847977 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:25.847939    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:05:25.848490 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:25.848116    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:05:25.848490 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:25.848189    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs podName:5578e0c2-249d-41f5-916d-71c590d15a4e nodeName:}" failed. No retries permitted until 2026-07-02 19:07:27.848173832 +0000 UTC m=+374.465899893 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs") pod "network-metrics-daemon-q7j9f" (UID: "5578e0c2-249d-41f5-916d-71c590d15a4e") : secret "metrics-daemon-secret" not found
Jul 02 19:05:39.746330 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.746259    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qnvkr"]
Jul 02 19:05:39.748115 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.748090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:39.752580 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.752561    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 19:05:39.752673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.752578    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8pnn8\""
Jul 02 19:05:39.752839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.752824    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 19:05:39.753716 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.753699    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.756849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.756834    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.769028 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.768996    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 19:05:39.803136 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.803115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qnvkr"]
Jul 02 19:05:39.810461 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.810440    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-b7n4s"]
Jul 02 19:05:39.812121 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.812104    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:39.817987 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.817957    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 19:05:39.818134 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.818115    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.824235 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.824217    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 19:05:39.824344 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.824231    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.824602 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.824586    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4kc9z\""
Jul 02 19:05:39.829378 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.829364    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 19:05:39.834153 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.834136    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"]
Jul 02 19:05:39.836602 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.836579    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79bf6499cd-52f57"]
Jul 02 19:05:39.836859 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.836844    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:39.840448 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.840427    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 19:05:39.840720 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.840705    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-b7n4s"]
Jul 02 19:05:39.840816 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.840803    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.841127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.840942    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:39.841127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.840943    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x86ml\""
Jul 02 19:05:39.841297 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.841281    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 19:05:39.841412 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.841395    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:39.843108 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.843090    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 19:05:39.843317 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.843304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lsvnr\""
Jul 02 19:05:39.843675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.843661    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 19:05:39.844394 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.844377    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 19:05:39.859801 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.859785    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 19:05:39.873443 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.873424    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79bf6499cd-52f57"]
Jul 02 19:05:39.890510 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.890491    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"]
Jul 02 19:05:39.942090 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5716715-9858-4e3e-9b4f-51cd49ff3cae-serving-cert\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:39.942090 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjfxw\" (UniqueName: \"kubernetes.io/projected/e5716715-9858-4e3e-9b4f-51cd49ff3cae-kube-api-access-rjfxw\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:39.942228 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5716715-9858-4e3e-9b4f-51cd49ff3cae-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:39.942228 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-certificates\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942228 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942171    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-bound-sa-token\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942228 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d682916b-5585-4223-b006-81ea2e6a4fd0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:39.942350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942243    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5716715-9858-4e3e-9b4f-51cd49ff3cae-snapshots\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:39.942350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2d7d\" (UniqueName: \"kubernetes.io/projected/d682916b-5585-4223-b006-81ea2e6a4fd0-kube-api-access-h2d7d\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:39.942350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lzz\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-kube-api-access-p7lzz\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-image-registry-private-configuration\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942496 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfvb\" (UniqueName: \"kubernetes.io/projected/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-kube-api-access-cpfvb\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:39.942496 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-trusted-ca\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942496 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-config\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:39.942496 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5716715-9858-4e3e-9b4f-51cd49ff3cae-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:39.942612 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f270e74c-6fab-4f71-8be2-8b64e8753171-ca-trust-extracted\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942612 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-installation-pull-secrets\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:39.942612 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-serving-cert\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:39.942612 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-trusted-ca\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:39.942612 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942578    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d682916b-5585-4223-b006-81ea2e6a4fd0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:39.942612 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:39.942606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5716715-9858-4e3e-9b4f-51cd49ff3cae-tmp\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.043991 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.043917    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.043991 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.043950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2d7d\" (UniqueName: \"kubernetes.io/projected/d682916b-5585-4223-b006-81ea2e6a4fd0-kube-api-access-h2d7d\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.043991 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.043980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lzz\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-kube-api-access-p7lzz\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.043998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-image-registry-private-configuration\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:40.044084    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:40.044100    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bf6499cd-52f57: secret "image-registry-tls" not found
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfvb\" (UniqueName: \"kubernetes.io/projected/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-kube-api-access-cpfvb\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:40.044165    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls podName:f270e74c-6fab-4f71-8be2-8b64e8753171 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:40.544145396 +0000 UTC m=+267.161871467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls") pod "image-registry-79bf6499cd-52f57" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171") : secret "image-registry-tls" not found
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-trusted-ca\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.044220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-config\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5716715-9858-4e3e-9b4f-51cd49ff3cae-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044300    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f270e74c-6fab-4f71-8be2-8b64e8753171-ca-trust-extracted\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-installation-pull-secrets\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-serving-cert\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044379    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-trusted-ca\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d682916b-5585-4223-b006-81ea2e6a4fd0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044436    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5716715-9858-4e3e-9b4f-51cd49ff3cae-tmp\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5716715-9858-4e3e-9b4f-51cd49ff3cae-serving-cert\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjfxw\" (UniqueName: \"kubernetes.io/projected/e5716715-9858-4e3e-9b4f-51cd49ff3cae-kube-api-access-rjfxw\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.044565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044549    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5716715-9858-4e3e-9b4f-51cd49ff3cae-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.045072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-certificates\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.045072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-bound-sa-token\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.045072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d682916b-5585-4223-b006-81ea2e6a4fd0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.045072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5716715-9858-4e3e-9b4f-51cd49ff3cae-snapshots\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.045072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044761    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f270e74c-6fab-4f71-8be2-8b64e8753171-ca-trust-extracted\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.045072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.044953    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5716715-9858-4e3e-9b4f-51cd49ff3cae-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.045376 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.045123    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-config\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.045376 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.045249    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-trusted-ca\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.045481 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.045454    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5716715-9858-4e3e-9b4f-51cd49ff3cae-tmp\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.045538 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.045494    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e5716715-9858-4e3e-9b4f-51cd49ff3cae-snapshots\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.046121 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.046074    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-certificates\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.046235 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.046122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d682916b-5585-4223-b006-81ea2e6a4fd0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.046235 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.046221    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-trusted-ca\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.046464 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.046440    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5716715-9858-4e3e-9b4f-51cd49ff3cae-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.047123 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.047104    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-image-registry-private-configuration\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.047262 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.047242    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-serving-cert\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.047759 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.047739    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5716715-9858-4e3e-9b4f-51cd49ff3cae-serving-cert\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.047921 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.047903    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d682916b-5585-4223-b006-81ea2e6a4fd0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.048448 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.048433    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-installation-pull-secrets\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.061445 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.061424    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-bound-sa-token\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.061870 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.061853    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2d7d\" (UniqueName: \"kubernetes.io/projected/d682916b-5585-4223-b006-81ea2e6a4fd0-kube-api-access-h2d7d\") pod \"kube-storage-version-migrator-operator-846bf668f7-jrzx5\" (UID: \"d682916b-5585-4223-b006-81ea2e6a4fd0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.062221 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.062206    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lzz\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-kube-api-access-p7lzz\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.062442 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.062422    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjfxw\" (UniqueName: \"kubernetes.io/projected/e5716715-9858-4e3e-9b4f-51cd49ff3cae-kube-api-access-rjfxw\") pod \"insights-operator-5c847dcfc4-b7n4s\" (UID: \"e5716715-9858-4e3e-9b4f-51cd49ff3cae\") " pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.062666 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.062651    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfvb\" (UniqueName: \"kubernetes.io/projected/c5d7edc4-4bec-43f5-9737-85bfcfd33fb3-kube-api-access-cpfvb\") pod \"console-operator-68b757fb67-qnvkr\" (UID: \"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3\") " pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.120030 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.119988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s"
Jul 02 19:05:40.146722 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.146699    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"
Jul 02 19:05:40.257123 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.257095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-b7n4s"]
Jul 02 19:05:40.259645 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:05:40.259620    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5716715_9858_4e3e_9b4f_51cd49ff3cae.slice/crio-8a31d63794777f6c713f1c1c0b55a91e14bbfff458f540e6225b036bfc262eda WatchSource:0}: Error finding container 8a31d63794777f6c713f1c1c0b55a91e14bbfff458f540e6225b036bfc262eda: Status 404 returned error can't find the container with id 8a31d63794777f6c713f1c1c0b55a91e14bbfff458f540e6225b036bfc262eda
Jul 02 19:05:40.274083 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.273979    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5"]
Jul 02 19:05:40.276134 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:05:40.276112    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd682916b_5585_4223_b006_81ea2e6a4fd0.slice/crio-9c5bcd43cf474dc6d346422b6a4d8179dee304d146eef2bccbdd4c3ba26c6242 WatchSource:0}: Error finding container 9c5bcd43cf474dc6d346422b6a4d8179dee304d146eef2bccbdd4c3ba26c6242: Status 404 returned error can't find the container with id 9c5bcd43cf474dc6d346422b6a4d8179dee304d146eef2bccbdd4c3ba26c6242
Jul 02 19:05:40.356241 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.356183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:40.489972 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.489840    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-qnvkr"]
Jul 02 19:05:40.492238 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:05:40.492211    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d7edc4_4bec_43f5_9737_85bfcfd33fb3.slice/crio-5d6e86204f96c1c2ecb932cc5143b6e4cff212c1c2615e730f94eb9d623ed6dd WatchSource:0}: Error finding container 5d6e86204f96c1c2ecb932cc5143b6e4cff212c1c2615e730f94eb9d623ed6dd: Status 404 returned error can't find the container with id 5d6e86204f96c1c2ecb932cc5143b6e4cff212c1c2615e730f94eb9d623ed6dd
Jul 02 19:05:40.548728 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.548704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:40.548859 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:40.548824    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:40.548859 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:40.548835    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bf6499cd-52f57: secret "image-registry-tls" not found
Jul 02 19:05:40.548942 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:40.548878    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls podName:f270e74c-6fab-4f71-8be2-8b64e8753171 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:41.548865501 +0000 UTC m=+268.166591558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls") pod "image-registry-79bf6499cd-52f57" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171") : secret "image-registry-tls" not found
Jul 02 19:05:40.749403 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.749361    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" event={"ID":"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3","Type":"ContainerStarted","Data":"5d6e86204f96c1c2ecb932cc5143b6e4cff212c1c2615e730f94eb9d623ed6dd"}
Jul 02 19:05:40.750460 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.750436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5" event={"ID":"d682916b-5585-4223-b006-81ea2e6a4fd0","Type":"ContainerStarted","Data":"9c5bcd43cf474dc6d346422b6a4d8179dee304d146eef2bccbdd4c3ba26c6242"}
Jul 02 19:05:40.751377 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:40.751351    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s" event={"ID":"e5716715-9858-4e3e-9b4f-51cd49ff3cae","Type":"ContainerStarted","Data":"8a31d63794777f6c713f1c1c0b55a91e14bbfff458f540e6225b036bfc262eda"}
Jul 02 19:05:41.555221 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:41.555188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:41.555383 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:41.555329    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:41.555383 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:41.555349    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bf6499cd-52f57: secret "image-registry-tls" not found
Jul 02 19:05:41.555472 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:41.555401    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls podName:f270e74c-6fab-4f71-8be2-8b64e8753171 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:43.55538592 +0000 UTC m=+270.173111980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls") pod "image-registry-79bf6499cd-52f57" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171") : secret "image-registry-tls" not found
Jul 02 19:05:43.569623 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.569577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:43.570102 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:43.569723    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:43.570102 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:43.569742    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bf6499cd-52f57: secret "image-registry-tls" not found
Jul 02 19:05:43.570102 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:43.569796    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls podName:f270e74c-6fab-4f71-8be2-8b64e8753171 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:47.569781445 +0000 UTC m=+274.187507501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls") pod "image-registry-79bf6499cd-52f57" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171") : secret "image-registry-tls" not found
Jul 02 19:05:43.762701 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.762664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s" event={"ID":"e5716715-9858-4e3e-9b4f-51cd49ff3cae","Type":"ContainerStarted","Data":"409a349615c75bb6ccf50d2b84089991be07ff41c5f0242f80e28cc12eaf3972"}
Jul 02 19:05:43.764357 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.764334    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/0.log"
Jul 02 19:05:43.764489 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.764378    2567 generic.go:356] "Generic (PLEG): container finished" podID="c5d7edc4-4bec-43f5-9737-85bfcfd33fb3" containerID="14b898ceff10923d7a5a6222b183ec2fcb7699a0081724dcaa94a91af9a73da8" exitCode=255
Jul 02 19:05:43.764489 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.764446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" event={"ID":"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3","Type":"ContainerDied","Data":"14b898ceff10923d7a5a6222b183ec2fcb7699a0081724dcaa94a91af9a73da8"}
Jul 02 19:05:43.764626 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.764611    2567 scope.go:117] "RemoveContainer" containerID="14b898ceff10923d7a5a6222b183ec2fcb7699a0081724dcaa94a91af9a73da8"
Jul 02 19:05:43.765977 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.765953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5" event={"ID":"d682916b-5585-4223-b006-81ea2e6a4fd0","Type":"ContainerStarted","Data":"de6435ea8aae3b9aabc83510531a49643aebddf64f4e3f8f1fcc18ba3c939790"}
Jul 02 19:05:43.779332 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.779284    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s" podStartSLOduration=1.677179886 podStartE2EDuration="4.779267325s" totalImagesPullingTime="3.102087439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:43.778367383 +0000 UTC m=+270.396093465" watchObservedRunningTime="2026-07-02 19:05:43.779267325 +0000 UTC m=+270.396993406"
Jul 02 19:05:43.792813 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:43.792769    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5" podStartSLOduration=1.712125426 podStartE2EDuration="4.792751217s" totalImagesPullingTime="3.080625791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:43.792176058 +0000 UTC m=+270.409902132" watchObservedRunningTime="2026-07-02 19:05:43.792751217 +0000 UTC m=+270.410477298"
Jul 02 19:05:44.771918 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:44.771891    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:05:44.772365 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:44.772348    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/0.log"
Jul 02 19:05:44.772417 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:44.772380    2567 generic.go:356] "Generic (PLEG): container finished" podID="c5d7edc4-4bec-43f5-9737-85bfcfd33fb3" containerID="5a0cbe0db769ce8b9483f620e5e29aaff2b9b657a597e98bfe5d0362848633cf" exitCode=255
Jul 02 19:05:44.772485 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:44.772459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" event={"ID":"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3","Type":"ContainerDied","Data":"5a0cbe0db769ce8b9483f620e5e29aaff2b9b657a597e98bfe5d0362848633cf"}
Jul 02 19:05:44.772554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:44.772522    2567 scope.go:117] "RemoveContainer" containerID="14b898ceff10923d7a5a6222b183ec2fcb7699a0081724dcaa94a91af9a73da8"
Jul 02 19:05:44.772805 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:44.772751    2567 scope.go:117] "RemoveContainer" containerID="5a0cbe0db769ce8b9483f620e5e29aaff2b9b657a597e98bfe5d0362848633cf"
Jul 02 19:05:44.773001 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:44.772972    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qnvkr_openshift-console-operator(c5d7edc4-4bec-43f5-9737-85bfcfd33fb3)\"" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" podUID="c5d7edc4-4bec-43f5-9737-85bfcfd33fb3"
Jul 02 19:05:45.217955 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.217924    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w4kwg"]
Jul 02 19:05:45.220400 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.220384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.223532 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.223511    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:05:45.223647 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.223535    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:05:45.223647 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.223604    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-969mm\""
Jul 02 19:05:45.242595 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.242570    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4kwg"]
Jul 02 19:05:45.286395 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.286367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.286514 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.286397    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-986j4\" (UniqueName: \"kubernetes.io/projected/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-api-access-986j4\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.286514 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.286424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75aefc8a-1179-4c2e-a5ac-869d440f366b-data-volume\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.286600 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.286529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.286600 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.286592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75aefc8a-1179-4c2e-a5ac-869d440f366b-crio-socket\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.387869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.387831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.388057 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.387888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75aefc8a-1179-4c2e-a5ac-869d440f366b-crio-socket\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.388057 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.387938    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.388057 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.387948    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.388057 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.387956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-986j4\" (UniqueName: \"kubernetes.io/projected/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-api-access-986j4\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.388057 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.388048    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:45.888005536 +0000 UTC m=+272.505731609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.388258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.388057    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/75aefc8a-1179-4c2e-a5ac-869d440f366b-crio-socket\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.388258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.388084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75aefc8a-1179-4c2e-a5ac-869d440f366b-data-volume\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.388258 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.388097    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.388258 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.388151    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:45.888135686 +0000 UTC m=+272.505861748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.388394 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.388338    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/75aefc8a-1179-4c2e-a5ac-869d440f366b-data-volume\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.398354 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.398325    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-986j4\" (UniqueName: \"kubernetes.io/projected/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-api-access-986j4\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.777081 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.777053    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:05:45.777448 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.777404    2567 scope.go:117] "RemoveContainer" containerID="5a0cbe0db769ce8b9483f620e5e29aaff2b9b657a597e98bfe5d0362848633cf"
Jul 02 19:05:45.777584 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.777564    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qnvkr_openshift-console-operator(c5d7edc4-4bec-43f5-9737-85bfcfd33fb3)\"" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" podUID="c5d7edc4-4bec-43f5-9737-85bfcfd33fb3"
Jul 02 19:05:45.892247 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.892208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.892420 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:45.892258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:45.892420 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.892352    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.892420 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.892388    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:45.892420 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.892408    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:46.892394581 +0000 UTC m=+273.510120640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:45.892582 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:45.892439    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:46.892426299 +0000 UTC m=+273.510152359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:46.898577 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:46.898539    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:46.899086 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:46.898588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:46.899086 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:46.898723    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:46.899086 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:46.898801    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:48.89878115 +0000 UTC m=+275.516507210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:46.899086 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:46.898733    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:46.899086 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:46.898860    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:48.89884808 +0000 UTC m=+275.516574135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:47.605243 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:47.605208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:47.605417 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:47.605327    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:47.605417 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:47.605339    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79bf6499cd-52f57: secret "image-registry-tls" not found
Jul 02 19:05:47.605417 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:47.605385    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls podName:f270e74c-6fab-4f71-8be2-8b64e8753171 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.605371491 +0000 UTC m=+282.223097546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls") pod "image-registry-79bf6499cd-52f57" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171") : secret "image-registry-tls" not found
Jul 02 19:05:47.792625 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:47.792598    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dhjtj_a9fbd075-b1d2-4ed7-a5bf-05771c992f32/dns-node-resolver/0.log"
Jul 02 19:05:48.917256 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:48.917219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:48.917634 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:48.917271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:48.917634 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:48.917365    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:48.917634 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:48.917424    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:52.91741038 +0000 UTC m=+279.535136436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:48.917634 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:48.917372    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:48.917634 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:48.917492    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:05:52.917480236 +0000 UTC m=+279.535206292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:49.191886 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:49.191812    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqdfw_1ab89a9b-52b3-46e9-a219-9a23779478dc/node-ca/0.log"
Jul 02 19:05:49.591180 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:49.591078    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lzs4_435b3531-7335-491b-bc65-8a959f46ac74/serve-healthcheck-canary/0.log"
Jul 02 19:05:50.356704 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:50.356670    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:50.357086 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:50.356722    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:05:50.357086 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:50.357007    2567 scope.go:117] "RemoveContainer" containerID="5a0cbe0db769ce8b9483f620e5e29aaff2b9b657a597e98bfe5d0362848633cf"
Jul 02 19:05:50.357179 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:50.357160    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-qnvkr_openshift-console-operator(c5d7edc4-4bec-43f5-9737-85bfcfd33fb3)\"" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" podUID="c5d7edc4-4bec-43f5-9737-85bfcfd33fb3"
Jul 02 19:05:50.593524 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:50.593497    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jrzx5_d682916b-5585-4223-b006-81ea2e6a4fd0/kube-storage-version-migrator-operator/0.log"
Jul 02 19:05:52.947504 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:52.947466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:52.947944 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:52.947514    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:05:52.947944 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:52.947619    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:05:52.947944 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:52.947653    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:52.947944 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:52.947680    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:06:00.94766681 +0000 UTC m=+287.565392868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : configmap "kube-rbac-proxy" not found
Jul 02 19:05:52.947944 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:52.947727    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls podName:75aefc8a-1179-4c2e-a5ac-869d440f366b nodeName:}" failed. No retries permitted until 2026-07-02 19:06:00.9477079 +0000 UTC m=+287.565433984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4kwg" (UID: "75aefc8a-1179-4c2e-a5ac-869d440f366b") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:05:55.502502 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:05:55.502457    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-r884g" podUID="37ebe3ab-fdd1-46b7-aa44-be602d2cdb93"
Jul 02 19:05:55.671544 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:55.671516    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:55.673858 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:55.673830    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"image-registry-79bf6499cd-52f57\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") " pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:55.751731 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:55.751706    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:55.806447 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:55.806417    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r884g"
Jul 02 19:05:55.877936 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:55.877910    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79bf6499cd-52f57"]
Jul 02 19:05:55.881824 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:05:55.881802    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf270e74c_6fab_4f71_8be2_8b64e8753171.slice/crio-44d21045f1c754e9d437c0e878938c7d8a8e570859a91cc2bb4f529f24fcdcc8 WatchSource:0}: Error finding container 44d21045f1c754e9d437c0e878938c7d8a8e570859a91cc2bb4f529f24fcdcc8: Status 404 returned error can't find the container with id 44d21045f1c754e9d437c0e878938c7d8a8e570859a91cc2bb4f529f24fcdcc8
Jul 02 19:05:56.810381 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:56.810349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bf6499cd-52f57" event={"ID":"f270e74c-6fab-4f71-8be2-8b64e8753171","Type":"ContainerStarted","Data":"62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187"}
Jul 02 19:05:56.810852 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:56.810398    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bf6499cd-52f57" event={"ID":"f270e74c-6fab-4f71-8be2-8b64e8753171","Type":"ContainerStarted","Data":"44d21045f1c754e9d437c0e878938c7d8a8e570859a91cc2bb4f529f24fcdcc8"}
Jul 02 19:05:56.810852 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:56.810460    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:05:56.831146 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:56.831097    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79bf6499cd-52f57" podStartSLOduration=17.831081288 podStartE2EDuration="17.831081288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:56.830133414 +0000 UTC m=+283.447859488" watchObservedRunningTime="2026-07-02 19:05:56.831081288 +0000 UTC m=+283.448807376"
Jul 02 19:05:58.595749 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:58.595715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:05:58.597951 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:58.597918    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37ebe3ab-fdd1-46b7-aa44-be602d2cdb93-metrics-tls\") pod \"dns-default-r884g\" (UID: \"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93\") " pod="openshift-dns/dns-default-r884g"
Jul 02 19:05:58.809601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:58.809569    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2dxc\""
Jul 02 19:05:58.817463 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:58.817441    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r884g"
Jul 02 19:05:58.945069 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:58.945029    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r884g"]
Jul 02 19:05:58.947354 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:05:58.947326    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ebe3ab_fdd1_46b7_aa44_be602d2cdb93.slice/crio-52e2c490b0d7e3267dd90fedd06f99413355f800a7548827de084699b71556f7 WatchSource:0}: Error finding container 52e2c490b0d7e3267dd90fedd06f99413355f800a7548827de084699b71556f7: Status 404 returned error can't find the container with id 52e2c490b0d7e3267dd90fedd06f99413355f800a7548827de084699b71556f7
Jul 02 19:05:59.821268 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:05:59.821236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r884g" event={"ID":"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93","Type":"ContainerStarted","Data":"52e2c490b0d7e3267dd90fedd06f99413355f800a7548827de084699b71556f7"}
Jul 02 19:06:00.827561 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:00.827528    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r884g" event={"ID":"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93","Type":"ContainerStarted","Data":"2a8b572da253b1414146e9d4110e1cfa1f8d7e5c6f0db9d2d959e43cdb4b6b4f"}
Jul 02 19:06:00.827961 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:00.827589    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r884g" event={"ID":"37ebe3ab-fdd1-46b7-aa44-be602d2cdb93","Type":"ContainerStarted","Data":"ca9610fddc732c176c6d00bc70df68fe8aac26058edb83e4cd34e87df77aebb6"}
Jul 02 19:06:00.827961 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:00.827661    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r884g"
Jul 02 19:06:00.844843 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:00.844798    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r884g" podStartSLOduration=251.157600473 podStartE2EDuration="4m12.844784509s" totalImagesPullingTime="1.687184036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:00.843788325 +0000 UTC m=+287.461514403" watchObservedRunningTime="2026-07-02 19:06:00.844784509 +0000 UTC m=+287.462510587"
Jul 02 19:06:01.016713 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.016612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:06:01.016713 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.016671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:06:01.017212 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.017196    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/75aefc8a-1179-4c2e-a5ac-869d440f366b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:06:01.018882 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.018863    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/75aefc8a-1179-4c2e-a5ac-869d440f366b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4kwg\" (UID: \"75aefc8a-1179-4c2e-a5ac-869d440f366b\") " pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:06:01.129209 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.129170    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4kwg"
Jul 02 19:06:01.255959 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.255923    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4kwg"]
Jul 02 19:06:01.258592 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:01.258569    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75aefc8a_1179_4c2e_a5ac_869d440f366b.slice/crio-ccc74e5326955d78eebb4af8ebbca5b44dad73dfddd1b596f3830d0422300f08 WatchSource:0}: Error finding container ccc74e5326955d78eebb4af8ebbca5b44dad73dfddd1b596f3830d0422300f08: Status 404 returned error can't find the container with id ccc74e5326955d78eebb4af8ebbca5b44dad73dfddd1b596f3830d0422300f08
Jul 02 19:06:01.834179 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:01.834125    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4kwg" event={"ID":"75aefc8a-1179-4c2e-a5ac-869d440f366b","Type":"ContainerStarted","Data":"ccc74e5326955d78eebb4af8ebbca5b44dad73dfddd1b596f3830d0422300f08"}
Jul 02 19:06:02.935061 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:02.935029    2567 scope.go:117] "RemoveContainer" containerID="5a0cbe0db769ce8b9483f620e5e29aaff2b9b657a597e98bfe5d0362848633cf"
Jul 02 19:06:05.850647 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.850609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4kwg" event={"ID":"75aefc8a-1179-4c2e-a5ac-869d440f366b","Type":"ContainerStarted","Data":"12b0aaa7da61bb5b584d440ca01de5c07eade75c4ca09263bc35bb2ee5ce662b"}
Jul 02 19:06:05.851100 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.850673    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4kwg" event={"ID":"75aefc8a-1179-4c2e-a5ac-869d440f366b","Type":"ContainerStarted","Data":"caa72b6c9cfb845e2828f9153efcca65442de7375932210d155bb9cbcb4d832c"}
Jul 02 19:06:05.852248 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.852231    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:06:05.852350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.852281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" event={"ID":"c5d7edc4-4bec-43f5-9737-85bfcfd33fb3","Type":"ContainerStarted","Data":"23551d57cf5b10fc87723d3c600bfa090bd666e7ad265e281d0dc205c117c014"}
Jul 02 19:06:05.852563 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.852528    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:06:05.856969 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.856950    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr"
Jul 02 19:06:05.870924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:05.870888    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-qnvkr" podStartSLOduration=24.00321531 podStartE2EDuration="26.870877756s" totalImagesPullingTime="2.867662446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:05.869924155 +0000 UTC m=+292.487650234" watchObservedRunningTime="2026-07-02 19:06:05.870877756 +0000 UTC m=+292.488603834"
Jul 02 19:06:08.456650 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.456619    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79bf6499cd-52f57"]
Jul 02 19:06:08.498859 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.498826    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c6bc5d5f9-hllff"]
Jul 02 19:06:08.501772 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.501757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.514821 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.514798    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c6bc5d5f9-hllff"]
Jul 02 19:06:08.577138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlp4f\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-kube-api-access-mlp4f\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd6199b-7d84-4826-94b7-c59a022e7ac4-trusted-ca\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd6199b-7d84-4826-94b7-c59a022e7ac4-installation-pull-secrets\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-registry-tls\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577211    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd6199b-7d84-4826-94b7-c59a022e7ac4-ca-trust-extracted\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577302    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-bound-sa-token\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd6199b-7d84-4826-94b7-c59a022e7ac4-registry-certificates\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.577565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.577401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd6199b-7d84-4826-94b7-c59a022e7ac4-image-registry-private-configuration\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678492 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd6199b-7d84-4826-94b7-c59a022e7ac4-image-registry-private-configuration\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678506    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlp4f\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-kube-api-access-mlp4f\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678528    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd6199b-7d84-4826-94b7-c59a022e7ac4-trusted-ca\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd6199b-7d84-4826-94b7-c59a022e7ac4-installation-pull-secrets\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-registry-tls\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd6199b-7d84-4826-94b7-c59a022e7ac4-ca-trust-extracted\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678673 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-bound-sa-token\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.678983 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.678685    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd6199b-7d84-4826-94b7-c59a022e7ac4-registry-certificates\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.679134 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.679075    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bd6199b-7d84-4826-94b7-c59a022e7ac4-ca-trust-extracted\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.679649 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.679612    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bd6199b-7d84-4826-94b7-c59a022e7ac4-trusted-ca\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.679765 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.679619    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bd6199b-7d84-4826-94b7-c59a022e7ac4-registry-certificates\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.681111 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.681090    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bd6199b-7d84-4826-94b7-c59a022e7ac4-image-registry-private-configuration\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.681194 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.681106    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bd6199b-7d84-4826-94b7-c59a022e7ac4-installation-pull-secrets\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.681280 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.681263    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-registry-tls\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.687362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.687339    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-bound-sa-token\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.687484 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.687467    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlp4f\" (UniqueName: \"kubernetes.io/projected/1bd6199b-7d84-4826-94b7-c59a022e7ac4-kube-api-access-mlp4f\") pod \"image-registry-c6bc5d5f9-hllff\" (UID: \"1bd6199b-7d84-4826-94b7-c59a022e7ac4\") " pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.810380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.810351    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:08.864854 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.864826    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4kwg" event={"ID":"75aefc8a-1179-4c2e-a5ac-869d440f366b","Type":"ContainerStarted","Data":"a0c7c1742d65e141320c859ead5152fae5569fd4ad845634dbd25412349b88ef"}
Jul 02 19:06:08.884278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.884229    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w4kwg" podStartSLOduration=16.913695785 podStartE2EDuration="23.884214345s" totalImagesPullingTime="6.97051856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:08.883705262 +0000 UTC m=+295.501431340" watchObservedRunningTime="2026-07-02 19:06:08.884214345 +0000 UTC m=+295.501940423"
Jul 02 19:06:08.934700 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:08.934617    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q7j9f" podUID="5578e0c2-249d-41f5-916d-71c590d15a4e"
Jul 02 19:06:08.944353 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:08.944332    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c6bc5d5f9-hllff"]
Jul 02 19:06:08.946529 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:08.946508    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd6199b_7d84_4826_94b7_c59a022e7ac4.slice/crio-4f422d7a98cd6d6acb54d6d6099734beb3640f1375fdcf8fb4a813af3af472de WatchSource:0}: Error finding container 4f422d7a98cd6d6acb54d6d6099734beb3640f1375fdcf8fb4a813af3af472de: Status 404 returned error can't find the container with id 4f422d7a98cd6d6acb54d6d6099734beb3640f1375fdcf8fb4a813af3af472de
Jul 02 19:06:09.869079 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:09.869044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff" event={"ID":"1bd6199b-7d84-4826-94b7-c59a022e7ac4","Type":"ContainerStarted","Data":"52765c32c1772bad4d57282901fe6666d8e3331ae2185996b0dde92996ca345e"}
Jul 02 19:06:09.869472 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:09.869141    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:09.869472 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:09.869174    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff" event={"ID":"1bd6199b-7d84-4826-94b7-c59a022e7ac4","Type":"ContainerStarted","Data":"4f422d7a98cd6d6acb54d6d6099734beb3640f1375fdcf8fb4a813af3af472de"}
Jul 02 19:06:09.887841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:09.887797    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff" podStartSLOduration=1.887784463 podStartE2EDuration="1.887784463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:09.886976678 +0000 UTC m=+296.504702767" watchObservedRunningTime="2026-07-02 19:06:09.887784463 +0000 UTC m=+296.505510540"
Jul 02 19:06:10.836300 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:10.836270    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r884g"
Jul 02 19:06:13.787410 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:13.787377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:06:13.790061 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:13.789988    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:06:13.791356 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:13.791340    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:06:13.793760 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:13.793733    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:06:13.797071 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:13.797054    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:06:18.462567 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:18.462538    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:06:21.420235 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.420203    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"]
Jul 02 19:06:21.423222 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.423207    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.443286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.443256    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:06:21.443408 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.443237    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 02 19:06:21.443632 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.443616    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r29q8\""
Jul 02 19:06:21.444605 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.444587    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:06:21.444674 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.444587    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 02 19:06:21.447146 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.447121    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 02 19:06:21.447244 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.447124    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:06:21.448625 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.448603    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6cgr5"]
Jul 02 19:06:21.451527 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.451510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"]
Jul 02 19:06:21.451615 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.451605    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.457595 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.457576    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:06:21.457855 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.457833    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:06:21.457961 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.457908    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:06:21.458099 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.458083    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jknhs\""
Jul 02 19:06:21.583400 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.583400 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-root\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583586 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-sys\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583586 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59bccca5-d733-4403-b6aa-e2ef19eef9d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.583586 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl7lv\" (UniqueName: \"kubernetes.io/projected/452418c6-4d59-4f62-8491-54bb5137a62a-kube-api-access-cl7lv\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583586 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/452418c6-4d59-4f62-8491-54bb5137a62a-metrics-client-ca\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583586 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-tls\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.583737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.583737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-textfile\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmp7\" (UniqueName: \"kubernetes.io/projected/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-api-access-slmp7\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.583737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.583909 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59bccca5-d733-4403-b6aa-e2ef19eef9d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.583909 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.583775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-wtmp\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.684699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.684699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-root\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.684699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-sys\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.684887 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684753    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-root\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.684887 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59bccca5-d733-4403-b6aa-e2ef19eef9d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.684949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl7lv\" (UniqueName: \"kubernetes.io/projected/452418c6-4d59-4f62-8491-54bb5137a62a-kube-api-access-cl7lv\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.684949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/452418c6-4d59-4f62-8491-54bb5137a62a-metrics-client-ca\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685063 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684957    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-sys\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685063 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.684996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-tls\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685157 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685059    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.685157 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.685253 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:21.685200    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 19:06:21.685356 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-textfile\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685492 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685492 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmp7\" (UniqueName: \"kubernetes.io/projected/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-api-access-slmp7\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.685492 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685458    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685492 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:21.685475    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-tls podName:452418c6-4d59-4f62-8491-54bb5137a62a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:22.18545395 +0000 UTC m=+308.803180019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-tls") pod "node-exporter-6cgr5" (UID: "452418c6-4d59-4f62-8491-54bb5137a62a") : secret "node-exporter-tls" not found
Jul 02 19:06:21.685721 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59bccca5-d733-4403-b6aa-e2ef19eef9d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.685721 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685564    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-wtmp\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685721 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685662    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/452418c6-4d59-4f62-8491-54bb5137a62a-metrics-client-ca\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685721 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685696    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59bccca5-d733-4403-b6aa-e2ef19eef9d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.685934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685743    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-wtmp\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685838    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.685934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685917    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-textfile\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.685934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.685925    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.686191 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.686103    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59bccca5-d733-4403-b6aa-e2ef19eef9d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.687584 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.687564    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.687639 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.687626    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.688062 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.688043    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.694219 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.694193    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl7lv\" (UniqueName: \"kubernetes.io/projected/452418c6-4d59-4f62-8491-54bb5137a62a-kube-api-access-cl7lv\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:21.694839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.694822    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmp7\" (UniqueName: \"kubernetes.io/projected/59bccca5-d733-4403-b6aa-e2ef19eef9d0-kube-api-access-slmp7\") pod \"kube-state-metrics-7c9dbb8b7d-lvps2\" (UID: \"59bccca5-d733-4403-b6aa-e2ef19eef9d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.736518 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.736485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"
Jul 02 19:06:21.866352 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.866323    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2"]
Jul 02 19:06:21.869085 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:21.869050    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bccca5_d733_4403_b6aa_e2ef19eef9d0.slice/crio-8168fec119601e34da6b613cabe6aebea53fc5cea74622a110b113b8b8c8b7dd WatchSource:0}: Error finding container 8168fec119601e34da6b613cabe6aebea53fc5cea74622a110b113b8b8c8b7dd: Status 404 returned error can't find the container with id 8168fec119601e34da6b613cabe6aebea53fc5cea74622a110b113b8b8c8b7dd
Jul 02 19:06:21.871216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.871202    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:06:21.910218 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:21.910196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2" event={"ID":"59bccca5-d733-4403-b6aa-e2ef19eef9d0","Type":"ContainerStarted","Data":"8168fec119601e34da6b613cabe6aebea53fc5cea74622a110b113b8b8c8b7dd"}
Jul 02 19:06:22.189365 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.189337    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-tls\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:22.191769 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.191744    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/452418c6-4d59-4f62-8491-54bb5137a62a-node-exporter-tls\") pod \"node-exporter-6cgr5\" (UID: \"452418c6-4d59-4f62-8491-54bb5137a62a\") " pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:22.360458 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.360422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6cgr5"
Jul 02 19:06:22.371433 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:22.371409    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452418c6_4d59_4f62_8491_54bb5137a62a.slice/crio-7489c645d86f6a5fa47b2c8025c610f4eaa3abfbf5238f464fa383536d62fd8f WatchSource:0}: Error finding container 7489c645d86f6a5fa47b2c8025c610f4eaa3abfbf5238f464fa383536d62fd8f: Status 404 returned error can't find the container with id 7489c645d86f6a5fa47b2c8025c610f4eaa3abfbf5238f464fa383536d62fd8f
Jul 02 19:06:22.414863 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.414832    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:06:22.418536 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.418507    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421370    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421381    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421381    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421443    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421451    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421382    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2cpnv\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421381    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 19:06:22.421573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421579    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 19:06:22.422262 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421579    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 19:06:22.422262 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.421872    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 19:06:22.433787 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.433759    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:06:22.593922 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.593829    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.593922 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.593899    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.593964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-web-config\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf5st\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-kube-api-access-jf5st\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594108    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-out\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594466 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594466 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594466 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594299    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.594466 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.594341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695785 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.695752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695946 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.695796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695946 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.695826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-web-config\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695946 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.695857    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695946 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.695885    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695946 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.695914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf5st\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-kube-api-access-jf5st\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.695946 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:22.695930    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 19:06:22.696286 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:22.696032    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls podName:1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:23.195991877 +0000 UTC m=+309.813717933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208") : secret "alertmanager-main-tls" not found
Jul 02 19:06:22.696286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-out\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696651 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696651 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.696754 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.696687    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.697511 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.697432    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.697969 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.697925    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.699461 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.699421    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.699561 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.699483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.700476 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.700448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-web-config\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.701151 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.701125    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.701380 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.701356    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.701859 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.701839    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-out\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.701953 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.701874    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.702027 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.701961    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.708244 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.708220    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf5st\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-kube-api-access-jf5st\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:22.915535 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.915498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cgr5" event={"ID":"452418c6-4d59-4f62-8491-54bb5137a62a","Type":"ContainerStarted","Data":"7489c645d86f6a5fa47b2c8025c610f4eaa3abfbf5238f464fa383536d62fd8f"}
Jul 02 19:06:22.934398 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:22.934365    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:06:23.200601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.200576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:23.203415 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.203396    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:23.328369 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.328115    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:23.658425 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.658396    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:06:23.661079 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:23.661036    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c016b1f_8aaa_4a50_8ed2_cd00bfbaa208.slice/crio-bd2838a8c80d3468b15b035c064fb6b679ab7d51e8bbe19865374fd170cb2b1d WatchSource:0}: Error finding container bd2838a8c80d3468b15b035c064fb6b679ab7d51e8bbe19865374fd170cb2b1d: Status 404 returned error can't find the container with id bd2838a8c80d3468b15b035c064fb6b679ab7d51e8bbe19865374fd170cb2b1d
Jul 02 19:06:23.919608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.919575    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"bd2838a8c80d3468b15b035c064fb6b679ab7d51e8bbe19865374fd170cb2b1d"}
Jul 02 19:06:23.921326 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.921302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2" event={"ID":"59bccca5-d733-4403-b6aa-e2ef19eef9d0","Type":"ContainerStarted","Data":"6a0d20834dfb0fd4b00cee79e9e3621f55c599640de8182490bed58dcb4e4016"}
Jul 02 19:06:23.921444 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.921354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2" event={"ID":"59bccca5-d733-4403-b6aa-e2ef19eef9d0","Type":"ContainerStarted","Data":"85cb3d0f3852775686d91de0f593d0261602405c4941fa42c3023f5874c75a2a"}
Jul 02 19:06:23.921444 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.921387    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2" event={"ID":"59bccca5-d733-4403-b6aa-e2ef19eef9d0","Type":"ContainerStarted","Data":"37308619755ef50dfe9e915c67366079469634755d47826d0b6deab2e3936615"}
Jul 02 19:06:23.922777 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.922757    2567 generic.go:356] "Generic (PLEG): container finished" podID="452418c6-4d59-4f62-8491-54bb5137a62a" containerID="b6abc4b2a967a56b59aaaf63bb2e7b3dbe5d4360fa3cb90163e6621ae769685b" exitCode=0
Jul 02 19:06:23.922853 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.922784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cgr5" event={"ID":"452418c6-4d59-4f62-8491-54bb5137a62a","Type":"ContainerDied","Data":"b6abc4b2a967a56b59aaaf63bb2e7b3dbe5d4360fa3cb90163e6621ae769685b"}
Jul 02 19:06:23.941372 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:23.941327    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lvps2" podStartSLOduration=1.629539603 podStartE2EDuration="2.941308897s" totalImagesPullingTime="1.311769294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:23.939411265 +0000 UTC m=+310.557137345" watchObservedRunningTime="2026-07-02 19:06:23.941308897 +0000 UTC m=+310.559034976"
Jul 02 19:06:24.928998 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.928934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cgr5" event={"ID":"452418c6-4d59-4f62-8491-54bb5137a62a","Type":"ContainerStarted","Data":"621f4c21eae95c962d38e08ec97d9de26e15be3ea7786a128605e93f7c0bce44"}
Jul 02 19:06:24.929457 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.929038    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6cgr5" event={"ID":"452418c6-4d59-4f62-8491-54bb5137a62a","Type":"ContainerStarted","Data":"db564cd61a18b90f89f3a24874ae39be90cd3e7615dfdec9825bc15373cf7e7a"}
Jul 02 19:06:24.953751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.953719    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bc5fd94d7-kv6bh"]
Jul 02 19:06:24.956964 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.956945    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:24.961185 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.961164    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:06:24.961553 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.961533    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:06:24.961886 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.961869    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47vkx\""
Jul 02 19:06:24.961973 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.961871    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 19:06:24.962273 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.962047    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6cgr5" podStartSLOduration=2.713674355 podStartE2EDuration="3.962032834s" totalImagesPullingTime="1.175999826s" totalInitContainerRuntime="72.358653ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:24.959783675 +0000 UTC m=+311.577509756" watchObservedRunningTime="2026-07-02 19:06:24.962032834 +0000 UTC m=+311.579758915"
Jul 02 19:06:24.962273 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.962121    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 19:06:24.962273 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.962155    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 19:06:24.962273 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.962173    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 19:06:24.962526 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.962304    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 19:06:24.978931 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.977248    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 19:06:24.981819 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:24.981795    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc5fd94d7-kv6bh"]
Jul 02 19:06:25.118167 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-oauth-config\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.118350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-oauth-serving-cert\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.118350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-config\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.118350 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-trusted-ca-bundle\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.118513 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-serving-cert\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.118513 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-service-ca\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.118513 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.118451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dxwx\" (UniqueName: \"kubernetes.io/projected/011e18ff-711f-4576-9cef-c4f7d929dc6e-kube-api-access-5dxwx\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219530 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219489    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-oauth-serving-cert\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219530 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-config\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-trusted-ca-bundle\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219642    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-serving-cert\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-service-ca\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dxwx\" (UniqueName: \"kubernetes.io/projected/011e18ff-711f-4576-9cef-c4f7d929dc6e-kube-api-access-5dxwx\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.219966 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.219807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-oauth-config\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.220361 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.220285    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-config\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.220737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.220705    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-service-ca\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.220869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.220848    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-oauth-serving-cert\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.221136 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.221114    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-trusted-ca-bundle\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.222499 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.222479    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-oauth-config\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.222890 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.222869    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-serving-cert\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.232599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.232574    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dxwx\" (UniqueName: \"kubernetes.io/projected/011e18ff-711f-4576-9cef-c4f7d929dc6e-kube-api-access-5dxwx\") pod \"console-5bc5fd94d7-kv6bh\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") " pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.268555 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.268530    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:25.398541 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.398521    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc5fd94d7-kv6bh"]
Jul 02 19:06:25.400448 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:25.400426    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011e18ff_711f_4576_9cef_c4f7d929dc6e.slice/crio-5f49174bcde09886a1650e447157d99ada4421564eed119d199805a7832280ed WatchSource:0}: Error finding container 5f49174bcde09886a1650e447157d99ada4421564eed119d199805a7832280ed: Status 404 returned error can't find the container with id 5f49174bcde09886a1650e447157d99ada4421564eed119d199805a7832280ed
Jul 02 19:06:25.859361 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.859333    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b9bf99685-wc9q2"]
Jul 02 19:06:25.862733 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.862712    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:25.866400 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.866379    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 19:06:25.866521 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.866382    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zd856\""
Jul 02 19:06:25.866521 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.866380    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 19:06:25.867040 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.867008    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 19:06:25.867767 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.867713    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 19:06:25.867881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.867766    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2evt8cb2eqij6\""
Jul 02 19:06:25.879049 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.879027    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b9bf99685-wc9q2"]
Jul 02 19:06:25.934366 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.934338    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2" exitCode=0
Jul 02 19:06:25.940047 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.940002    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"}
Jul 02 19:06:25.940152 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:25.940080    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5fd94d7-kv6bh" event={"ID":"011e18ff-711f-4576-9cef-c4f7d929dc6e","Type":"ContainerStarted","Data":"5f49174bcde09886a1650e447157d99ada4421564eed119d199805a7832280ed"}
Jul 02 19:06:26.025737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.025699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-client-ca-bundle\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.025884 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.025742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/602d6f6d-c409-42cb-921c-82460c5bb84b-audit-log\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.025884 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.025860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-secret-metrics-server-tls\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.025982 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.025891    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d6f6d-c409-42cb-921c-82460c5bb84b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.026048 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.025980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.026048 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.026033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/602d6f6d-c409-42cb-921c-82460c5bb84b-metrics-server-audit-profiles\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.026126 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.026085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54dr6\" (UniqueName: \"kubernetes.io/projected/602d6f6d-c409-42cb-921c-82460c5bb84b-kube-api-access-54dr6\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127434 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/602d6f6d-c409-42cb-921c-82460c5bb84b-metrics-server-audit-profiles\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127434 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54dr6\" (UniqueName: \"kubernetes.io/projected/602d6f6d-c409-42cb-921c-82460c5bb84b-kube-api-access-54dr6\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127548 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-client-ca-bundle\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127548 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/602d6f6d-c409-42cb-921c-82460c5bb84b-audit-log\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127653 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-secret-metrics-server-tls\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.127653 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.127627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d6f6d-c409-42cb-921c-82460c5bb84b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.128304 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.128245    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/602d6f6d-c409-42cb-921c-82460c5bb84b-audit-log\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.128444 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.128402    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/602d6f6d-c409-42cb-921c-82460c5bb84b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.128915 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.128880    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/602d6f6d-c409-42cb-921c-82460c5bb84b-metrics-server-audit-profiles\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.130414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.130364    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.130679 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.130657    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-secret-metrics-server-tls\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.131186 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.131167    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/602d6f6d-c409-42cb-921c-82460c5bb84b-client-ca-bundle\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.141731 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.141707    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54dr6\" (UniqueName: \"kubernetes.io/projected/602d6f6d-c409-42cb-921c-82460c5bb84b-kube-api-access-54dr6\") pod \"metrics-server-5b9bf99685-wc9q2\" (UID: \"602d6f6d-c409-42cb-921c-82460c5bb84b\") " pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.174178 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.174156    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:26.329614 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.329554    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b9bf99685-wc9q2"]
Jul 02 19:06:26.331978 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:26.331933    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602d6f6d_c409_42cb_921c_82460c5bb84b.slice/crio-c48ef5b1e5acba5fdf69e3990953765e9459ddd8a2e71fa9bdf78ab49ddea5df WatchSource:0}: Error finding container c48ef5b1e5acba5fdf69e3990953765e9459ddd8a2e71fa9bdf78ab49ddea5df: Status 404 returned error can't find the container with id c48ef5b1e5acba5fdf69e3990953765e9459ddd8a2e71fa9bdf78ab49ddea5df
Jul 02 19:06:26.702152 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.702114    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69f6ff4d96-92596"]
Jul 02 19:06:26.705842 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.705795    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.708791 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.708624    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 02 19:06:26.708791 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.708652    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cfw77\""
Jul 02 19:06:26.708791 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.708668    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 02 19:06:26.709050 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.708910    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 02 19:06:26.709270 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.709221    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 02 19:06:26.709376 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.709305    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 02 19:06:26.715907 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.715529    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 02 19:06:26.723065 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.723039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69f6ff4d96-92596"]
Jul 02 19:06:26.734226 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-serving-certs-ca-bundle\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734364 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734234    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734364 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-metrics-client-ca\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734364 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734364 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mhj\" (UniqueName: \"kubernetes.io/projected/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-kube-api-access-g5mhj\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734580 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-telemeter-client-tls\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734580 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-federate-client-tls\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.734580 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.734558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-secret-telemeter-client\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-serving-certs-ca-bundle\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835128    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-metrics-client-ca\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835229    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mhj\" (UniqueName: \"kubernetes.io/projected/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-kube-api-access-g5mhj\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-telemeter-client-tls\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-federate-client-tls\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-secret-telemeter-client\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.835924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.835866    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-serving-certs-ca-bundle\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.836536 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.836278    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.836536 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.836411    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-metrics-client-ca\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.839292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.838626    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.839292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.839240    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-secret-telemeter-client\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.839449 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.839332    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-telemeter-client-tls\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.839790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.839771    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-federate-client-tls\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.844453 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.844404    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mhj\" (UniqueName: \"kubernetes.io/projected/254d07eb-e443-4aef-8a42-f6cea4d8ddf4-kube-api-access-g5mhj\") pod \"telemeter-client-69f6ff4d96-92596\" (UID: \"254d07eb-e443-4aef-8a42-f6cea4d8ddf4\") " pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:26.942354 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:26.942289    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2" event={"ID":"602d6f6d-c409-42cb-921c-82460c5bb84b","Type":"ContainerStarted","Data":"c48ef5b1e5acba5fdf69e3990953765e9459ddd8a2e71fa9bdf78ab49ddea5df"}
Jul 02 19:06:27.022958 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:27.022657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596"
Jul 02 19:06:27.379444 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:27.379389    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69f6ff4d96-92596"]
Jul 02 19:06:27.951494 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:27.951422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"}
Jul 02 19:06:28.437284 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:28.437255    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254d07eb_e443_4aef_8a42_f6cea4d8ddf4.slice/crio-fc55defc512c0d9d830aecda2a73dded73e43087bfae42844bf56931456f04a5 WatchSource:0}: Error finding container fc55defc512c0d9d830aecda2a73dded73e43087bfae42844bf56931456f04a5: Status 404 returned error can't find the container with id fc55defc512c0d9d830aecda2a73dded73e43087bfae42844bf56931456f04a5
Jul 02 19:06:28.956842 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:28.956769    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2" event={"ID":"602d6f6d-c409-42cb-921c-82460c5bb84b","Type":"ContainerStarted","Data":"0f278f1f49f3cf74a56712e5ff3e19d252b48f40587d9cae6bceef5ee1451ae0"}
Jul 02 19:06:28.958222 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:28.958175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596" event={"ID":"254d07eb-e443-4aef-8a42-f6cea4d8ddf4","Type":"ContainerStarted","Data":"fc55defc512c0d9d830aecda2a73dded73e43087bfae42844bf56931456f04a5"}
Jul 02 19:06:28.960516 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:28.960417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"}
Jul 02 19:06:28.962048 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:28.962026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5fd94d7-kv6bh" event={"ID":"011e18ff-711f-4576-9cef-c4f7d929dc6e","Type":"ContainerStarted","Data":"7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2"}
Jul 02 19:06:28.978231 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:28.978186    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2" podStartSLOduration=1.454152865 podStartE2EDuration="3.978167686s" totalImagesPullingTime="2.524014821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:28.977121539 +0000 UTC m=+315.594847611" watchObservedRunningTime="2026-07-02 19:06:28.978167686 +0000 UTC m=+315.595893766"
Jul 02 19:06:28.996815 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:28.996763    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bc5fd94d7-kv6bh" podStartSLOduration=1.53979018 podStartE2EDuration="4.996743398s" totalImagesPullingTime="3.456953218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:28.995604803 +0000 UTC m=+315.613330882" watchObservedRunningTime="2026-07-02 19:06:28.996743398 +0000 UTC m=+315.614469487"
Jul 02 19:06:29.971507 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:29.971474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"}
Jul 02 19:06:29.971993 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:29.971564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"}
Jul 02 19:06:29.971993 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:29.971600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"}
Jul 02 19:06:30.882872 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:30.882848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c6bc5d5f9-hllff"
Jul 02 19:06:30.978942 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:30.978910    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerStarted","Data":"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"}
Jul 02 19:06:30.981277 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:30.981253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596" event={"ID":"254d07eb-e443-4aef-8a42-f6cea4d8ddf4","Type":"ContainerStarted","Data":"244f1b7469fe555c78b3f5c7d9682d99e5836ad2f87651f49f7235724d6d3575"}
Jul 02 19:06:30.981382 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:30.981303    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596" event={"ID":"254d07eb-e443-4aef-8a42-f6cea4d8ddf4","Type":"ContainerStarted","Data":"354d803dbf3ea4022183693f19c5a32b183a74f32abc3dd142f453de7af54917"}
Jul 02 19:06:30.981382 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:30.981327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596" event={"ID":"254d07eb-e443-4aef-8a42-f6cea4d8ddf4","Type":"ContainerStarted","Data":"31dbf0f38adec911862799e8787550e7f133deb919a565f0ee14d0173b809769"}
Jul 02 19:06:31.016675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:31.016633    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.2659241 podStartE2EDuration="9.016618235s" totalImagesPullingTime="3.732513788s" totalInitContainerRuntime="18.180347ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:31.014593057 +0000 UTC m=+317.632319135" watchObservedRunningTime="2026-07-02 19:06:31.016618235 +0000 UTC m=+317.634344335"
Jul 02 19:06:31.043344 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:31.043289    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69f6ff4d96-92596" podStartSLOduration=2.893256832 podStartE2EDuration="5.04326882s" totalImagesPullingTime="2.150011988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:31.040065853 +0000 UTC m=+317.657791932" watchObservedRunningTime="2026-07-02 19:06:31.04326882 +0000 UTC m=+317.660994902"
Jul 02 19:06:32.092999 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.092969    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc5fd94d7-kv6bh"]
Jul 02 19:06:32.123323 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.123296    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f559846d5-m2hdc"]
Jul 02 19:06:32.133578 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.133494    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.135281 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.135259    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f559846d5-m2hdc"]
Jul 02 19:06:32.191449 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-oauth-serving-cert\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.191624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-config\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.191624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-trusted-ca-bundle\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.191624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-oauth-config\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.191624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-serving-cert\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.191784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-service-ca\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.191784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.191699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b8h5\" (UniqueName: \"kubernetes.io/projected/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-kube-api-access-2b8h5\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292098 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-trusted-ca-bundle\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-oauth-config\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-serving-cert\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-service-ca\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b8h5\" (UniqueName: \"kubernetes.io/projected/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-kube-api-access-2b8h5\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292468 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292291    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-oauth-serving-cert\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292468 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-config\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.292962 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292937    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-service-ca\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.293100 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.292987    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-oauth-serving-cert\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.293149 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.293104    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-trusted-ca-bundle\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.293309 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.293286    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-config\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.294805 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.294775    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-oauth-config\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.294805 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.294798    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-serving-cert\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.301845 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.301822    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b8h5\" (UniqueName: \"kubernetes.io/projected/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-kube-api-access-2b8h5\") pod \"console-f559846d5-m2hdc\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") " pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.442986 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.442949    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:32.570357 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.570332    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f559846d5-m2hdc"]
Jul 02 19:06:32.572482 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:06:32.572458    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf8a17d_3738_4cb0_8aba_f4b51097ff58.slice/crio-2dacbc18061c14c9868b5d4a088d2d7151663962c61de5058d1873390585574d WatchSource:0}: Error finding container 2dacbc18061c14c9868b5d4a088d2d7151663962c61de5058d1873390585574d: Status 404 returned error can't find the container with id 2dacbc18061c14c9868b5d4a088d2d7151663962c61de5058d1873390585574d
Jul 02 19:06:32.990854 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.990820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f559846d5-m2hdc" event={"ID":"8cf8a17d-3738-4cb0-8aba-f4b51097ff58","Type":"ContainerStarted","Data":"c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594"}
Jul 02 19:06:32.991040 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:32.990872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f559846d5-m2hdc" event={"ID":"8cf8a17d-3738-4cb0-8aba-f4b51097ff58","Type":"ContainerStarted","Data":"2dacbc18061c14c9868b5d4a088d2d7151663962c61de5058d1873390585574d"}
Jul 02 19:06:33.016537 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.016479    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f559846d5-m2hdc" podStartSLOduration=1.016460142 podStartE2EDuration="1.016460142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.015552002 +0000 UTC m=+319.633278081" watchObservedRunningTime="2026-07-02 19:06:33.016460142 +0000 UTC m=+319.634186232"
Jul 02 19:06:33.477547 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.477503    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79bf6499cd-52f57" podUID="f270e74c-6fab-4f71-8be2-8b64e8753171" containerName="registry" containerID="cri-o://62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187" gracePeriod=30
Jul 02 19:06:33.716632 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.716607    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:06:33.806317 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806227    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-image-registry-private-configuration\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806317 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806280    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-installation-pull-secrets\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806553 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806357    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-certificates\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806553 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f270e74c-6fab-4f71-8be2-8b64e8753171-ca-trust-extracted\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806553 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806553 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806475    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-trusted-ca\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806775 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806660    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7lzz\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-kube-api-access-p7lzz\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806775 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806715    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-bound-sa-token\") pod \"f270e74c-6fab-4f71-8be2-8b64e8753171\" (UID: \"f270e74c-6fab-4f71-8be2-8b64e8753171\") "
Jul 02 19:06:33.806891 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806865    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:33.806951 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.806876    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:33.807372 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.807343    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-trusted-ca\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.807509 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.807374    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-certificates\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.808767 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.808740    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:33.808979 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.808952    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:33.809281 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.809256    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:33.809360 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.809295    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-kube-api-access-p7lzz" (OuterVolumeSpecName: "kube-api-access-p7lzz") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "kube-api-access-p7lzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:33.809360 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.809310    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:33.815539 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.815516    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f270e74c-6fab-4f71-8be2-8b64e8753171-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f270e74c-6fab-4f71-8be2-8b64e8753171" (UID: "f270e74c-6fab-4f71-8be2-8b64e8753171"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:06:33.907896 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.907865    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f270e74c-6fab-4f71-8be2-8b64e8753171-ca-trust-extracted\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.907896 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.907892    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-registry-tls\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.907896 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.907901    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7lzz\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-kube-api-access-p7lzz\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.908194 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.907911    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f270e74c-6fab-4f71-8be2-8b64e8753171-bound-sa-token\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.908194 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.907921    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-image-registry-private-configuration\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.908194 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.907930    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f270e74c-6fab-4f71-8be2-8b64e8753171-installation-pull-secrets\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:33.994753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.994723    2567 generic.go:356] "Generic (PLEG): container finished" podID="f270e74c-6fab-4f71-8be2-8b64e8753171" containerID="62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187" exitCode=0
Jul 02 19:06:33.994892 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.994773    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79bf6499cd-52f57"
Jul 02 19:06:33.994892 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.994802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bf6499cd-52f57" event={"ID":"f270e74c-6fab-4f71-8be2-8b64e8753171","Type":"ContainerDied","Data":"62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187"}
Jul 02 19:06:33.994892 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.994851    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79bf6499cd-52f57" event={"ID":"f270e74c-6fab-4f71-8be2-8b64e8753171","Type":"ContainerDied","Data":"44d21045f1c754e9d437c0e878938c7d8a8e570859a91cc2bb4f529f24fcdcc8"}
Jul 02 19:06:33.994892 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:33.994877    2567 scope.go:117] "RemoveContainer" containerID="62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187"
Jul 02 19:06:34.002762 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:34.002744    2567 scope.go:117] "RemoveContainer" containerID="62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187"
Jul 02 19:06:34.003004 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:34.002982    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187\": container with ID starting with 62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187 not found: ID does not exist" containerID="62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187"
Jul 02 19:06:34.003068 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:34.003032    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187"} err="failed to get container status \"62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187\": rpc error: code = NotFound desc = could not find container \"62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187\": container with ID starting with 62466cf8dcbd64bf307f232cefeb1f61404a4de57ce5b516b026ec8bccf69187 not found: ID does not exist"
Jul 02 19:06:34.010398 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:34.010379    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79bf6499cd-52f57"]
Jul 02 19:06:34.014474 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:34.014456    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79bf6499cd-52f57"]
Jul 02 19:06:35.268959 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:35.268931    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:35.939072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:35.939041    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f270e74c-6fab-4f71-8be2-8b64e8753171" path="/var/lib/kubelet/pods/f270e74c-6fab-4f71-8be2-8b64e8753171/volumes"
Jul 02 19:06:42.443414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:42.443377    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:42.443904 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:42.443436    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:42.448002 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:42.447979    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:43.033998 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:43.033970    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:06:46.174624 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:46.174579    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:46.175140 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:46.174658    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:06:55.076361 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:55.076328    2567 generic.go:356] "Generic (PLEG): container finished" podID="d682916b-5585-4223-b006-81ea2e6a4fd0" containerID="de6435ea8aae3b9aabc83510531a49643aebddf64f4e3f8f1fcc18ba3c939790" exitCode=0
Jul 02 19:06:55.076762 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:55.076402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5" event={"ID":"d682916b-5585-4223-b006-81ea2e6a4fd0","Type":"ContainerDied","Data":"de6435ea8aae3b9aabc83510531a49643aebddf64f4e3f8f1fcc18ba3c939790"}
Jul 02 19:06:55.076762 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:55.076729    2567 scope.go:117] "RemoveContainer" containerID="de6435ea8aae3b9aabc83510531a49643aebddf64f4e3f8f1fcc18ba3c939790"
Jul 02 19:06:56.081592 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:56.081556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-jrzx5" event={"ID":"d682916b-5585-4223-b006-81ea2e6a4fd0","Type":"ContainerStarted","Data":"8d436e1211ab2759aa4412b2125fcf1a02b6db461dccba4238f1d8427c38f933"}
Jul 02 19:06:57.113129 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.113085    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bc5fd94d7-kv6bh" podUID="011e18ff-711f-4576-9cef-c4f7d929dc6e" containerName="console" containerID="cri-o://7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2" gracePeriod=15
Jul 02 19:06:57.376322 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.376261    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:57.509250 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509218    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-service-ca\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509250 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509254    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-serving-cert\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509500 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509307    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-trusted-ca-bundle\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509500 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509335    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-oauth-serving-cert\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509500 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509372    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dxwx\" (UniqueName: \"kubernetes.io/projected/011e18ff-711f-4576-9cef-c4f7d929dc6e-kube-api-access-5dxwx\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509500 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-config\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509500 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509425    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-oauth-config\") pod \"011e18ff-711f-4576-9cef-c4f7d929dc6e\" (UID: \"011e18ff-711f-4576-9cef-c4f7d929dc6e\") "
Jul 02 19:06:57.509740 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509646    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-service-ca" (OuterVolumeSpecName: "service-ca") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:57.509866 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509825    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:57.509866 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509834    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-config" (OuterVolumeSpecName: "console-config") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:57.509866 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.509845    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:57.511780 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.511752    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:57.511868 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.511804    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:57.511868 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.511832    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011e18ff-711f-4576-9cef-c4f7d929dc6e-kube-api-access-5dxwx" (OuterVolumeSpecName: "kube-api-access-5dxwx") pod "011e18ff-711f-4576-9cef-c4f7d929dc6e" (UID: "011e18ff-711f-4576-9cef-c4f7d929dc6e"). InnerVolumeSpecName "kube-api-access-5dxwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:57.610949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610917    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-service-ca\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:57.610949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610944    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-serving-cert\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:57.610949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610954    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-trusted-ca-bundle\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:57.611170 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610964    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-oauth-serving-cert\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:57.611170 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610973    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dxwx\" (UniqueName: \"kubernetes.io/projected/011e18ff-711f-4576-9cef-c4f7d929dc6e-kube-api-access-5dxwx\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:57.611170 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610982    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-config\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:57.611170 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:57.610990    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/011e18ff-711f-4576-9cef-c4f7d929dc6e-console-oauth-config\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:06:58.090078 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.090047    2567 generic.go:356] "Generic (PLEG): container finished" podID="011e18ff-711f-4576-9cef-c4f7d929dc6e" containerID="7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2" exitCode=0
Jul 02 19:06:58.090208 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.090089    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5fd94d7-kv6bh"
Jul 02 19:06:58.090208 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.090103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5fd94d7-kv6bh" event={"ID":"011e18ff-711f-4576-9cef-c4f7d929dc6e","Type":"ContainerDied","Data":"7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2"}
Jul 02 19:06:58.090208 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.090145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5fd94d7-kv6bh" event={"ID":"011e18ff-711f-4576-9cef-c4f7d929dc6e","Type":"ContainerDied","Data":"5f49174bcde09886a1650e447157d99ada4421564eed119d199805a7832280ed"}
Jul 02 19:06:58.090208 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.090164    2567 scope.go:117] "RemoveContainer" containerID="7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2"
Jul 02 19:06:58.098079 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.098061    2567 scope.go:117] "RemoveContainer" containerID="7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2"
Jul 02 19:06:58.098354 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:06:58.098335    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2\": container with ID starting with 7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2 not found: ID does not exist" containerID="7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2"
Jul 02 19:06:58.098396 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.098363    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2"} err="failed to get container status \"7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2\": rpc error: code = NotFound desc = could not find container \"7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2\": container with ID starting with 7405eb8c35b8f0369911ec12f15d63aa9d267c4cd6a18735876e510a9b8851f2 not found: ID does not exist"
Jul 02 19:06:58.107907 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.107871    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc5fd94d7-kv6bh"]
Jul 02 19:06:58.109262 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:58.109235    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bc5fd94d7-kv6bh"]
Jul 02 19:06:59.939164 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:06:59.939130    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011e18ff-711f-4576-9cef-c4f7d929dc6e" path="/var/lib/kubelet/pods/011e18ff-711f-4576-9cef-c4f7d929dc6e/volumes"
Jul 02 19:07:06.180114 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:06.180041    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:07:06.183925 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:06.183901    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b9bf99685-wc9q2"
Jul 02 19:07:14.148990 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:14.148951    2567 generic.go:356] "Generic (PLEG): container finished" podID="e5716715-9858-4e3e-9b4f-51cd49ff3cae" containerID="409a349615c75bb6ccf50d2b84089991be07ff41c5f0242f80e28cc12eaf3972" exitCode=0
Jul 02 19:07:14.149435 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:14.149034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s" event={"ID":"e5716715-9858-4e3e-9b4f-51cd49ff3cae","Type":"ContainerDied","Data":"409a349615c75bb6ccf50d2b84089991be07ff41c5f0242f80e28cc12eaf3972"}
Jul 02 19:07:14.149435 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:14.149396    2567 scope.go:117] "RemoveContainer" containerID="409a349615c75bb6ccf50d2b84089991be07ff41c5f0242f80e28cc12eaf3972"
Jul 02 19:07:15.154573 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:15.154541    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-b7n4s" event={"ID":"e5716715-9858-4e3e-9b4f-51cd49ff3cae","Type":"ContainerStarted","Data":"0c9710a35f6921f938705cbbfa6e57dcfc6ab0231da12f03853eb4ae6b429e4c"}
Jul 02 19:07:27.856642 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:27.856582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:07:27.858877 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:27.858853    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5578e0c2-249d-41f5-916d-71c590d15a4e-metrics-certs\") pod \"network-metrics-daemon-q7j9f\" (UID: \"5578e0c2-249d-41f5-916d-71c590d15a4e\") " pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:07:28.038662 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:28.038637    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h66dc\""
Jul 02 19:07:28.046356 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:28.046328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q7j9f"
Jul 02 19:07:28.212037 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:28.211986    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q7j9f"]
Jul 02 19:07:28.214436 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:07:28.214408    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5578e0c2_249d_41f5_916d_71c590d15a4e.slice/crio-e1390ccdc3d0d3c5b0ecaea153deefc777c7a563ab53f6db4de4668046ad5695 WatchSource:0}: Error finding container e1390ccdc3d0d3c5b0ecaea153deefc777c7a563ab53f6db4de4668046ad5695: Status 404 returned error can't find the container with id e1390ccdc3d0d3c5b0ecaea153deefc777c7a563ab53f6db4de4668046ad5695
Jul 02 19:07:29.209224 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:29.209148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7j9f" event={"ID":"5578e0c2-249d-41f5-916d-71c590d15a4e","Type":"ContainerStarted","Data":"e1390ccdc3d0d3c5b0ecaea153deefc777c7a563ab53f6db4de4668046ad5695"}
Jul 02 19:07:30.214652 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:30.214618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7j9f" event={"ID":"5578e0c2-249d-41f5-916d-71c590d15a4e","Type":"ContainerStarted","Data":"34d1f4ddb0e9fba7c7b99153e9460ba7b6d506d0cd22f2ab012fb0bf2d0c55ba"}
Jul 02 19:07:30.215098 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:30.214697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q7j9f" event={"ID":"5578e0c2-249d-41f5-916d-71c590d15a4e","Type":"ContainerStarted","Data":"d74e455a3ea1c2650a757bb427d2d312ca5b0909e7dd8cf11aaf4e28f5958eff"}
Jul 02 19:07:30.232373 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:30.232318    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q7j9f" podStartSLOduration=375.270269102 podStartE2EDuration="6m16.23230212s" totalImagesPullingTime="962.033018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:30.231111803 +0000 UTC m=+376.848837882" watchObservedRunningTime="2026-07-02 19:07:30.23230212 +0000 UTC m=+376.850028198"
Jul 02 19:07:41.668630 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.668597    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:07:41.669176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.668895    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="alertmanager" containerID="cri-o://871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356" gracePeriod=120
Jul 02 19:07:41.669176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.668965    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-web" containerID="cri-o://a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5" gracePeriod=120
Jul 02 19:07:41.669176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.668901    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-metric" containerID="cri-o://23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824" gracePeriod=120
Jul 02 19:07:41.669176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.668984    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="prom-label-proxy" containerID="cri-o://5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a" gracePeriod=120
Jul 02 19:07:41.669176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.668981    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy" containerID="cri-o://c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d" gracePeriod=120
Jul 02 19:07:41.669176 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:41.669028    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="config-reloader" containerID="cri-o://1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8" gracePeriod=120
Jul 02 19:07:42.259210 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259174    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a" exitCode=0
Jul 02 19:07:42.259210 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259197    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d" exitCode=0
Jul 02 19:07:42.259210 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259206    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8" exitCode=0
Jul 02 19:07:42.259210 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259213    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356" exitCode=0
Jul 02 19:07:42.259482 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"}
Jul 02 19:07:42.259482 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259303    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"}
Jul 02 19:07:42.259482 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"}
Jul 02 19:07:42.259482 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.259355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"}
Jul 02 19:07:42.906342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.906317    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:42.989661 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989628    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-volume\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.989841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989682    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-web\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.989841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989729    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-web-config\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.989841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.989841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989792    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf5st\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-kube-api-access-jf5st\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.989841 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989826    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-trusted-ca-bundle\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990104 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989872    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990104 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989902    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990104 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989943    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-cluster-tls-config\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990104 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.989973    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-tls-assets\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990104 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.990031    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-out\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.990119    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-main-db\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.990179    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-metrics-client-ca\") pod \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\" (UID: \"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208\") "
Jul 02 19:07:42.990884 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.990858    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:42.996316 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996234    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:07:42.996554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996531    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:42.996657 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996617    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:42.996741 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996633    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:42.996848 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996686    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:42.997061 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996740    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-volume" (OuterVolumeSpecName: "config-volume") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:42.997061 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.996753    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:42.997783 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.997754    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:07:42.998575 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.998538    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-kube-api-access-jf5st" (OuterVolumeSpecName: "kube-api-access-jf5st") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "kube-api-access-jf5st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:07:42.998575 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:42.998541    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-out" (OuterVolumeSpecName: "config-out") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:07:43.000789 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.000753    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:43.007777 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.007755    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-web-config" (OuterVolumeSpecName: "web-config") pod "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" (UID: "1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:43.091832 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091797    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-metrics-client-ca\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.091832 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091824    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-volume\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.091832 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091836    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091851    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-web-config\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091865    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-main-tls\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091875    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf5st\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-kube-api-access-jf5st\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091883    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091892    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091901    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091911    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-cluster-tls-config\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091919    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-tls-assets\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091927    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-config-out\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.092089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.091939    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208-alertmanager-main-db\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:07:43.267849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267773    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824" exitCode=0
Jul 02 19:07:43.267849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267798    2567 generic.go:356] "Generic (PLEG): container finished" podID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerID="a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5" exitCode=0
Jul 02 19:07:43.267849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"}
Jul 02 19:07:43.268052 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267866    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.268052 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"}
Jul 02 19:07:43.268052 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208","Type":"ContainerDied","Data":"bd2838a8c80d3468b15b035c064fb6b679ab7d51e8bbe19865374fd170cb2b1d"}
Jul 02 19:07:43.268052 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.267964    2567 scope.go:117] "RemoveContainer" containerID="5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"
Jul 02 19:07:43.276160 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.276131    2567 scope.go:117] "RemoveContainer" containerID="23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"
Jul 02 19:07:43.282968 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.282944    2567 scope.go:117] "RemoveContainer" containerID="c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"
Jul 02 19:07:43.289398 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.289383    2567 scope.go:117] "RemoveContainer" containerID="a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"
Jul 02 19:07:43.294692 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.294672    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:07:43.296926 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.296896    2567 scope.go:117] "RemoveContainer" containerID="1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"
Jul 02 19:07:43.298275 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.298258    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:07:43.303617 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.303601    2567 scope.go:117] "RemoveContainer" containerID="871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"
Jul 02 19:07:43.310082 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.310065    2567 scope.go:117] "RemoveContainer" containerID="e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"
Jul 02 19:07:43.316223 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.316206    2567 scope.go:117] "RemoveContainer" containerID="5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"
Jul 02 19:07:43.316476 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.316446    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a\": container with ID starting with 5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a not found: ID does not exist" containerID="5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"
Jul 02 19:07:43.316560 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.316483    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"} err="failed to get container status \"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a\": rpc error: code = NotFound desc = could not find container \"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a\": container with ID starting with 5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a not found: ID does not exist"
Jul 02 19:07:43.316560 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.316508    2567 scope.go:117] "RemoveContainer" containerID="23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"
Jul 02 19:07:43.316766 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.316749    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824\": container with ID starting with 23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824 not found: ID does not exist" containerID="23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"
Jul 02 19:07:43.316834 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.316774    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"} err="failed to get container status \"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824\": rpc error: code = NotFound desc = could not find container \"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824\": container with ID starting with 23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824 not found: ID does not exist"
Jul 02 19:07:43.316834 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.316798    2567 scope.go:117] "RemoveContainer" containerID="c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"
Jul 02 19:07:43.316996 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.316980    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d\": container with ID starting with c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d not found: ID does not exist" containerID="c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"
Jul 02 19:07:43.317111 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317002    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"} err="failed to get container status \"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d\": rpc error: code = NotFound desc = could not find container \"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d\": container with ID starting with c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d not found: ID does not exist"
Jul 02 19:07:43.317111 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317042    2567 scope.go:117] "RemoveContainer" containerID="a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"
Jul 02 19:07:43.317270 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.317252    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5\": container with ID starting with a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5 not found: ID does not exist" containerID="a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"
Jul 02 19:07:43.317331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317280    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"} err="failed to get container status \"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5\": rpc error: code = NotFound desc = could not find container \"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5\": container with ID starting with a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5 not found: ID does not exist"
Jul 02 19:07:43.317331 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317302    2567 scope.go:117] "RemoveContainer" containerID="1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"
Jul 02 19:07:43.317562 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.317546    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8\": container with ID starting with 1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8 not found: ID does not exist" containerID="1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"
Jul 02 19:07:43.317601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317567    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"} err="failed to get container status \"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8\": rpc error: code = NotFound desc = could not find container \"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8\": container with ID starting with 1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8 not found: ID does not exist"
Jul 02 19:07:43.317601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317581    2567 scope.go:117] "RemoveContainer" containerID="871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"
Jul 02 19:07:43.317774 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.317755    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356\": container with ID starting with 871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356 not found: ID does not exist" containerID="871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"
Jul 02 19:07:43.317861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317780    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"} err="failed to get container status \"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356\": rpc error: code = NotFound desc = could not find container \"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356\": container with ID starting with 871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356 not found: ID does not exist"
Jul 02 19:07:43.317861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.317796    2567 scope.go:117] "RemoveContainer" containerID="e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"
Jul 02 19:07:43.318092 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:07:43.318071    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2\": container with ID starting with e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2 not found: ID does not exist" containerID="e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"
Jul 02 19:07:43.318172 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318097    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"} err="failed to get container status \"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2\": rpc error: code = NotFound desc = could not find container \"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2\": container with ID starting with e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2 not found: ID does not exist"
Jul 02 19:07:43.318172 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318116    2567 scope.go:117] "RemoveContainer" containerID="5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"
Jul 02 19:07:43.318381 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318351    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a"} err="failed to get container status \"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a\": rpc error: code = NotFound desc = could not find container \"5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a\": container with ID starting with 5677dc46b5cafc84e9d27fd64d069931cecf0081d8e49a27c6e77fc1834c404a not found: ID does not exist"
Jul 02 19:07:43.318381 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318372    2567 scope.go:117] "RemoveContainer" containerID="23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"
Jul 02 19:07:43.318636 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318620    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824"} err="failed to get container status \"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824\": rpc error: code = NotFound desc = could not find container \"23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824\": container with ID starting with 23e85f223d4a73b2cafe5098ffef2ef03316ccd493019ba5bf45aaebb3f8d824 not found: ID does not exist"
Jul 02 19:07:43.318636 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318637    2567 scope.go:117] "RemoveContainer" containerID="c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"
Jul 02 19:07:43.318872 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318853    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d"} err="failed to get container status \"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d\": rpc error: code = NotFound desc = could not find container \"c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d\": container with ID starting with c924669d6f4fc72046a9a0705ddd0a9270b4008c2a0eb0c294d49f18a48a812d not found: ID does not exist"
Jul 02 19:07:43.318920 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.318873    2567 scope.go:117] "RemoveContainer" containerID="a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"
Jul 02 19:07:43.319114 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319098    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5"} err="failed to get container status \"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5\": rpc error: code = NotFound desc = could not find container \"a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5\": container with ID starting with a69968bf4f94d91d63e0399dc728e2b28f83fd3007c7f80b1adafcdf73aba1d5 not found: ID does not exist"
Jul 02 19:07:43.319167 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319114    2567 scope.go:117] "RemoveContainer" containerID="1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"
Jul 02 19:07:43.319318 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319300    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8"} err="failed to get container status \"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8\": rpc error: code = NotFound desc = could not find container \"1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8\": container with ID starting with 1c7580d73d2474a70b1fe8d435d12900e114b14e833bf20eb0f6c0969c8b82d8 not found: ID does not exist"
Jul 02 19:07:43.319363 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319320    2567 scope.go:117] "RemoveContainer" containerID="871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"
Jul 02 19:07:43.319514 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319498    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356"} err="failed to get container status \"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356\": rpc error: code = NotFound desc = could not find container \"871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356\": container with ID starting with 871072b0420f37eddbbb9e2f9e7f84cd9665af9b0d8aede55ba5ca3e1d56c356 not found: ID does not exist"
Jul 02 19:07:43.319555 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319514    2567 scope.go:117] "RemoveContainer" containerID="e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"
Jul 02 19:07:43.319737 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.319719    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2"} err="failed to get container status \"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2\": rpc error: code = NotFound desc = could not find container \"e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2\": container with ID starting with e8d130e6beb462c91489f5cb1f7fb112e1c1e6bef704ca9147fc7aa96035cbe2 not found: ID does not exist"
Jul 02 19:07:43.327730 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.327712    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:07:43.327970 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.327958    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-metric"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.327972    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-metric"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.327981    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="prom-label-proxy"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.327986    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="prom-label-proxy"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.327996    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f270e74c-6fab-4f71-8be2-8b64e8753171" containerName="registry"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328002    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f270e74c-6fab-4f71-8be2-8b64e8753171" containerName="registry"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328023    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-web"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328032    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-web"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328041    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="alertmanager"
Jul 02 19:07:43.328045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328047    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="alertmanager"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328055    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011e18ff-711f-4576-9cef-c4f7d929dc6e" containerName="console"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328060    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="011e18ff-711f-4576-9cef-c4f7d929dc6e" containerName="console"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328067    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="config-reloader"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328072    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="config-reloader"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328082    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="init-config-reloader"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328087    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="init-config-reloader"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328092    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328098    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328142    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="alertmanager"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328151    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="config-reloader"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328157    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="011e18ff-711f-4576-9cef-c4f7d929dc6e" containerName="console"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328163    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="prom-label-proxy"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328170    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f270e74c-6fab-4f71-8be2-8b64e8753171" containerName="registry"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328177    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328182    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-metric"
Jul 02 19:07:43.328305 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.328187    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" containerName="kube-rbac-proxy-web"
Jul 02 19:07:43.332877 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.332861    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.335968 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.335916    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 19:07:43.335968 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.335954    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 19:07:43.336204 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336189    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 19:07:43.336284 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336196    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 19:07:43.336336 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336327    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 19:07:43.336386 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336250    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2cpnv\""
Jul 02 19:07:43.336386 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336378    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 19:07:43.336386 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 19:07:43.336650 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.336378    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 19:07:43.342790 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.342774    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 19:07:43.346764 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.346746    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:07:43.494938 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.494906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ca503f0-36ae-49c2-ae91-b524a733c4a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.494946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.494966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-web-config\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.494982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d96zm\" (UniqueName: \"kubernetes.io/projected/2ca503f0-36ae-49c2-ae91-b524a733c4a5-kube-api-access-d96zm\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495049    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ca503f0-36ae-49c2-ae91-b524a733c4a5-config-out\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495127 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495118    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2ca503f0-36ae-49c2-ae91-b524a733c4a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca503f0-36ae-49c2-ae91-b524a733c4a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ca503f0-36ae-49c2-ae91-b524a733c4a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.495351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.495267    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596329 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596250    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ca503f0-36ae-49c2-ae91-b524a733c4a5-config-out\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596329 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596329 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2ca503f0-36ae-49c2-ae91-b524a733c4a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596329 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca503f0-36ae-49c2-ae91-b524a733c4a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596633 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596633 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596633 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ca503f0-36ae-49c2-ae91-b524a733c4a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596633 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596633 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ca503f0-36ae-49c2-ae91-b524a733c4a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-web-config\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d96zm\" (UniqueName: \"kubernetes.io/projected/2ca503f0-36ae-49c2-ae91-b524a733c4a5-kube-api-access-d96zm\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.596869 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.596732    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2ca503f0-36ae-49c2-ae91-b524a733c4a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.597274 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.597228    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ca503f0-36ae-49c2-ae91-b524a733c4a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.597564 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.597497    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca503f0-36ae-49c2-ae91-b524a733c4a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.599596 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.599540    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.599697 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.599656    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-web-config\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.599933 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.599907    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.599933 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.599923    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ca503f0-36ae-49c2-ae91-b524a733c4a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.600057 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.599929    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.600057 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.600008    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ca503f0-36ae-49c2-ae91-b524a733c4a5-config-out\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.600269 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.600253    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.600370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.600348    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.601160 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.601140    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2ca503f0-36ae-49c2-ae91-b524a733c4a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.608062 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.608037    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d96zm\" (UniqueName: \"kubernetes.io/projected/2ca503f0-36ae-49c2-ae91-b524a733c4a5-kube-api-access-d96zm\") pod \"alertmanager-main-0\" (UID: \"2ca503f0-36ae-49c2-ae91-b524a733c4a5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.642856 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.642832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:07:43.782479 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.782462    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:07:43.784527 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:07:43.784494    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca503f0_36ae_49c2_ae91_b524a733c4a5.slice/crio-74ef2d61159beacaed9dcd857ee27b9eacfb851364312072bbf36cc428320268 WatchSource:0}: Error finding container 74ef2d61159beacaed9dcd857ee27b9eacfb851364312072bbf36cc428320268: Status 404 returned error can't find the container with id 74ef2d61159beacaed9dcd857ee27b9eacfb851364312072bbf36cc428320268
Jul 02 19:07:43.938675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:43.938643    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208" path="/var/lib/kubelet/pods/1c016b1f-8aaa-4a50-8ed2-cd00bfbaa208/volumes"
Jul 02 19:07:44.273008 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:44.272977    2567 generic.go:356] "Generic (PLEG): container finished" podID="2ca503f0-36ae-49c2-ae91-b524a733c4a5" containerID="80d9342c094c4d82606ead83a24e621aadc2a0a54ad4fc11b8f95d120d65cec9" exitCode=0
Jul 02 19:07:44.273216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:44.273073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerDied","Data":"80d9342c094c4d82606ead83a24e621aadc2a0a54ad4fc11b8f95d120d65cec9"}
Jul 02 19:07:44.273216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:44.273160    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"74ef2d61159beacaed9dcd857ee27b9eacfb851364312072bbf36cc428320268"}
Jul 02 19:07:45.280861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.280824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"a881fd463215011893b497e0feb1b80ccbd226c6932420f5a8980d1714d74925"}
Jul 02 19:07:45.281258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.280934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"013a772a2758bb8685b1cdb6d4e571c8869071583a49e5d7db9c6f86f4b40cae"}
Jul 02 19:07:45.281258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.280977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"4f71902274186852c587bd2a4bc8f87510b153c0a2f50be514b2c9543bca74c4"}
Jul 02 19:07:45.281258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.281036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"ac88ffbed1531618b221e1e22e2ba73f32a14f3053da6be137451718920033f2"}
Jul 02 19:07:45.281258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.281074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"d2d064c96e3d0972b251b181732049483503fb12a3d9d84107c27b50200c0163"}
Jul 02 19:07:45.281258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.281109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2ca503f0-36ae-49c2-ae91-b524a733c4a5","Type":"ContainerStarted","Data":"19bfad7a7c0e3f6db7b3098b164062696e5f857d2d9f197c2cf321e4eb14fa9c"}
Jul 02 19:07:45.332275 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:45.332199    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.315221595 podStartE2EDuration="2.332184385s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.96279ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:07:45.331490073 +0000 UTC m=+391.949216175" watchObservedRunningTime="2026-07-02 19:07:45.332184385 +0000 UTC m=+391.949910463"
Jul 02 19:07:50.915311 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:07:50.915281    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f559846d5-m2hdc"]
Jul 02 19:08:15.936351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:15.936304    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f559846d5-m2hdc" podUID="8cf8a17d-3738-4cb0-8aba-f4b51097ff58" containerName="console" containerID="cri-o://c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594" gracePeriod=15
Jul 02 19:08:16.193066 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.192950    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:08:16.256051 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256003    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-oauth-config\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256214 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256068    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-trusted-ca-bundle\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256214 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256096    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b8h5\" (UniqueName: \"kubernetes.io/projected/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-kube-api-access-2b8h5\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256236    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-serving-cert\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256303    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-config\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256342 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256334    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-service-ca\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256499 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-oauth-serving-cert\") pod \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\" (UID: \"8cf8a17d-3738-4cb0-8aba-f4b51097ff58\") "
Jul 02 19:08:16.256629 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256505    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:08:16.256728 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256711    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-trusted-ca-bundle\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.256781 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256706    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-config" (OuterVolumeSpecName: "console-config") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:08:16.256850 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.256825    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:08:16.257113 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.257078    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-service-ca" (OuterVolumeSpecName: "service-ca") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:08:16.258279 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.258253    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:08:16.258395 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.258298    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:08:16.258395 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.258360    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-kube-api-access-2b8h5" (OuterVolumeSpecName: "kube-api-access-2b8h5") pod "8cf8a17d-3738-4cb0-8aba-f4b51097ff58" (UID: "8cf8a17d-3738-4cb0-8aba-f4b51097ff58"). InnerVolumeSpecName "kube-api-access-2b8h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:08:16.357374 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.357341    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-config\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.357374 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.357369    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-service-ca\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.357374 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.357380    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-oauth-serving-cert\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.357608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.357389    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-oauth-config\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.357608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.357398    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b8h5\" (UniqueName: \"kubernetes.io/projected/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-kube-api-access-2b8h5\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.357608 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.357406    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf8a17d-3738-4cb0-8aba-f4b51097ff58-console-serving-cert\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:08:16.394620 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.394586    2567 generic.go:356] "Generic (PLEG): container finished" podID="8cf8a17d-3738-4cb0-8aba-f4b51097ff58" containerID="c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594" exitCode=0
Jul 02 19:08:16.394713 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.394637    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f559846d5-m2hdc"
Jul 02 19:08:16.394713 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.394676    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f559846d5-m2hdc" event={"ID":"8cf8a17d-3738-4cb0-8aba-f4b51097ff58","Type":"ContainerDied","Data":"c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594"}
Jul 02 19:08:16.394777 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.394750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f559846d5-m2hdc" event={"ID":"8cf8a17d-3738-4cb0-8aba-f4b51097ff58","Type":"ContainerDied","Data":"2dacbc18061c14c9868b5d4a088d2d7151663962c61de5058d1873390585574d"}
Jul 02 19:08:16.394777 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.394771    2567 scope.go:117] "RemoveContainer" containerID="c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594"
Jul 02 19:08:16.403296 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.403281    2567 scope.go:117] "RemoveContainer" containerID="c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594"
Jul 02 19:08:16.403564 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:08:16.403543    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594\": container with ID starting with c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594 not found: ID does not exist" containerID="c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594"
Jul 02 19:08:16.403601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.403572    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594"} err="failed to get container status \"c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594\": rpc error: code = NotFound desc = could not find container \"c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594\": container with ID starting with c13a73a66761b122d5ac61b3364bb2557ddc510409a7bb3ae408fc5b3c0d6594 not found: ID does not exist"
Jul 02 19:08:16.417274 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.417247    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f559846d5-m2hdc"]
Jul 02 19:08:16.421605 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:16.421587    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f559846d5-m2hdc"]
Jul 02 19:08:17.939137 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:17.939106    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf8a17d-3738-4cb0-8aba-f4b51097ff58" path="/var/lib/kubelet/pods/8cf8a17d-3738-4cb0-8aba-f4b51097ff58/volumes"
Jul 02 19:08:40.980720 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.980644    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"]
Jul 02 19:08:40.981105 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.980909    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf8a17d-3738-4cb0-8aba-f4b51097ff58" containerName="console"
Jul 02 19:08:40.981105 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.980919    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf8a17d-3738-4cb0-8aba-f4b51097ff58" containerName="console"
Jul 02 19:08:40.981105 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.980983    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf8a17d-3738-4cb0-8aba-f4b51097ff58" containerName="console"
Jul 02 19:08:40.983767 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.983751    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:40.990488 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.990466    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:08:40.991692 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.991677    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:08:40.991779 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.991683    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 19:08:40.991779 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:40.991683    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:08:41.005477 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.005458    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"]
Jul 02 19:08:41.049308 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.049278    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtzlz\" (UniqueName: \"kubernetes.io/projected/57a45f80-d15e-4f5f-87ae-0370a05e8a09-kube-api-access-gtzlz\") pod \"managed-serviceaccount-addon-agent-5b5884687d-5m9rf\" (UID: \"57a45f80-d15e-4f5f-87ae-0370a05e8a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.049440 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.049320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57a45f80-d15e-4f5f-87ae-0370a05e8a09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b5884687d-5m9rf\" (UID: \"57a45f80-d15e-4f5f-87ae-0370a05e8a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.100038 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.099994    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"]
Jul 02 19:08:41.102968 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.102951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.105838 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.105815    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 19:08:41.121337 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.121316    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"]
Jul 02 19:08:41.150249 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.150216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtzlz\" (UniqueName: \"kubernetes.io/projected/57a45f80-d15e-4f5f-87ae-0370a05e8a09-kube-api-access-gtzlz\") pod \"managed-serviceaccount-addon-agent-5b5884687d-5m9rf\" (UID: \"57a45f80-d15e-4f5f-87ae-0370a05e8a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.150415 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.150260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57a45f80-d15e-4f5f-87ae-0370a05e8a09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b5884687d-5m9rf\" (UID: \"57a45f80-d15e-4f5f-87ae-0370a05e8a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.152659 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.152636    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57a45f80-d15e-4f5f-87ae-0370a05e8a09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b5884687d-5m9rf\" (UID: \"57a45f80-d15e-4f5f-87ae-0370a05e8a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.178811 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.178788    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtzlz\" (UniqueName: \"kubernetes.io/projected/57a45f80-d15e-4f5f-87ae-0370a05e8a09-kube-api-access-gtzlz\") pod \"managed-serviceaccount-addon-agent-5b5884687d-5m9rf\" (UID: \"57a45f80-d15e-4f5f-87ae-0370a05e8a09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.250784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.250711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6jq\" (UniqueName: \"kubernetes.io/projected/64f956f5-6d08-4e34-b308-e0b8b160944c-kube-api-access-cl6jq\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.250784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.250745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64f956f5-6d08-4e34-b308-e0b8b160944c-tmp\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.250784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.250777    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64f956f5-6d08-4e34-b308-e0b8b160944c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.308374 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.308347    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"
Jul 02 19:08:41.351551 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.351519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64f956f5-6d08-4e34-b308-e0b8b160944c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.351714 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.351614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6jq\" (UniqueName: \"kubernetes.io/projected/64f956f5-6d08-4e34-b308-e0b8b160944c-kube-api-access-cl6jq\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.351714 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.351637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64f956f5-6d08-4e34-b308-e0b8b160944c-tmp\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.352032 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.351994    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64f956f5-6d08-4e34-b308-e0b8b160944c-tmp\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.354114 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.354094    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64f956f5-6d08-4e34-b308-e0b8b160944c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.360531 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.360505    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6jq\" (UniqueName: \"kubernetes.io/projected/64f956f5-6d08-4e34-b308-e0b8b160944c-kube-api-access-cl6jq\") pod \"klusterlet-addon-workmgr-7896c498db-hbsdz\" (UID: \"64f956f5-6d08-4e34-b308-e0b8b160944c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.412535 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.412283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:41.466084 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.466053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf"]
Jul 02 19:08:41.467965 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:08:41.467923    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57a45f80_d15e_4f5f_87ae_0370a05e8a09.slice/crio-d443c5ca06413e6da40595ef90ec627c4428df6700f2c512294a4c93190e8445 WatchSource:0}: Error finding container d443c5ca06413e6da40595ef90ec627c4428df6700f2c512294a4c93190e8445: Status 404 returned error can't find the container with id d443c5ca06413e6da40595ef90ec627c4428df6700f2c512294a4c93190e8445
Jul 02 19:08:41.490079 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.490046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf" event={"ID":"57a45f80-d15e-4f5f-87ae-0370a05e8a09","Type":"ContainerStarted","Data":"d443c5ca06413e6da40595ef90ec627c4428df6700f2c512294a4c93190e8445"}
Jul 02 19:08:41.545513 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:41.545443    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"]
Jul 02 19:08:41.550027 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:08:41.549988    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f956f5_6d08_4e34_b308_e0b8b160944c.slice/crio-55b635b9f27f50aa6d1e6620bdcde1d4ec23bc342e682efdfbf75f0b5d61ab13 WatchSource:0}: Error finding container 55b635b9f27f50aa6d1e6620bdcde1d4ec23bc342e682efdfbf75f0b5d61ab13: Status 404 returned error can't find the container with id 55b635b9f27f50aa6d1e6620bdcde1d4ec23bc342e682efdfbf75f0b5d61ab13
Jul 02 19:08:42.497535 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:42.497490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz" event={"ID":"64f956f5-6d08-4e34-b308-e0b8b160944c","Type":"ContainerStarted","Data":"55b635b9f27f50aa6d1e6620bdcde1d4ec23bc342e682efdfbf75f0b5d61ab13"}
Jul 02 19:08:44.508269 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:44.508236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf" event={"ID":"57a45f80-d15e-4f5f-87ae-0370a05e8a09","Type":"ContainerStarted","Data":"266b956daab44ca51e8d9e2aecf88363264cbcd084877b5e3d941e1b65f2b026"}
Jul 02 19:08:44.526469 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:44.526414    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b5884687d-5m9rf" podStartSLOduration=1.5926440240000002 podStartE2EDuration="4.526393758s" totalImagesPullingTime="2.933749734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:44.525527885 +0000 UTC m=+451.143253964" watchObservedRunningTime="2026-07-02 19:08:44.526393758 +0000 UTC m=+451.144119847"
Jul 02 19:08:46.517341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:46.517304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz" event={"ID":"64f956f5-6d08-4e34-b308-e0b8b160944c","Type":"ContainerStarted","Data":"fc90e3aaa66aae8fabf0686e75fb426d45edd7a2845ba55f93e12df50fb8b8de"}
Jul 02 19:08:46.517843 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:46.517484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:46.519285 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:46.519262    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz"
Jul 02 19:08:46.541494 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:08:46.541442    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7896c498db-hbsdz" podStartSLOduration=1.350327827 podStartE2EDuration="5.541423451s" totalImagesPullingTime="4.191095624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:46.540764827 +0000 UTC m=+453.158490918" watchObservedRunningTime="2026-07-02 19:08:46.541423451 +0000 UTC m=+453.159149529"
Jul 02 19:09:21.630533 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.630498    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"]
Jul 02 19:09:21.634086 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.634068    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.637610 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.637588    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 19:09:21.637722 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.637613    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 19:09:21.637722 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.637613    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hjhwc\""
Jul 02 19:09:21.645166 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.645145    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"]
Jul 02 19:09:21.688871 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.688845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/3a25b081-b9f2-40e9-9e64-5a0ab512ba81-kube-api-access-8pp75\") pod \"cert-manager-cainjector-559cdd8c87-vd9z5\" (UID: \"3a25b081-b9f2-40e9-9e64-5a0ab512ba81\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.689037 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.688883    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a25b081-b9f2-40e9-9e64-5a0ab512ba81-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vd9z5\" (UID: \"3a25b081-b9f2-40e9-9e64-5a0ab512ba81\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.790237 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.790203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/3a25b081-b9f2-40e9-9e64-5a0ab512ba81-kube-api-access-8pp75\") pod \"cert-manager-cainjector-559cdd8c87-vd9z5\" (UID: \"3a25b081-b9f2-40e9-9e64-5a0ab512ba81\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.790237 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.790239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a25b081-b9f2-40e9-9e64-5a0ab512ba81-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vd9z5\" (UID: \"3a25b081-b9f2-40e9-9e64-5a0ab512ba81\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.799875 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.799854    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a25b081-b9f2-40e9-9e64-5a0ab512ba81-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vd9z5\" (UID: \"3a25b081-b9f2-40e9-9e64-5a0ab512ba81\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.800008 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.799919    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pp75\" (UniqueName: \"kubernetes.io/projected/3a25b081-b9f2-40e9-9e64-5a0ab512ba81-kube-api-access-8pp75\") pod \"cert-manager-cainjector-559cdd8c87-vd9z5\" (UID: \"3a25b081-b9f2-40e9-9e64-5a0ab512ba81\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:21.942962 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:21.942941    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"
Jul 02 19:09:22.072463 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:22.072442    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5"]
Jul 02 19:09:22.074712 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:09:22.074678    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a25b081_b9f2_40e9_9e64_5a0ab512ba81.slice/crio-ab671aa688d07d71dec688ca5ba4a1ca467b4b275a9bdebc3cb58759f812d448 WatchSource:0}: Error finding container ab671aa688d07d71dec688ca5ba4a1ca467b4b275a9bdebc3cb58759f812d448: Status 404 returned error can't find the container with id ab671aa688d07d71dec688ca5ba4a1ca467b4b275a9bdebc3cb58759f812d448
Jul 02 19:09:22.654628 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:22.654594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5" event={"ID":"3a25b081-b9f2-40e9-9e64-5a0ab512ba81","Type":"ContainerStarted","Data":"ab671aa688d07d71dec688ca5ba4a1ca467b4b275a9bdebc3cb58759f812d448"}
Jul 02 19:09:25.669457 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:25.669423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5" event={"ID":"3a25b081-b9f2-40e9-9e64-5a0ab512ba81","Type":"ContainerStarted","Data":"d6a109d70c59e0519cfeca44131cf2a21f00007fe267d23b6beecba8a27b4130"}
Jul 02 19:09:25.700078 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:25.700005    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vd9z5" podStartSLOduration=1.627695216 podStartE2EDuration="4.69998421s" totalImagesPullingTime="3.072288994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:25.698226364 +0000 UTC m=+492.315952442" watchObservedRunningTime="2026-07-02 19:09:25.69998421 +0000 UTC m=+492.317710288"
Jul 02 19:09:49.530596 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.530558    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"]
Jul 02 19:09:49.532961 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.532938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.537603 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.537584    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xghdc\""
Jul 02 19:09:49.537777 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.537758    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:09:49.537996 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.537982    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:09:49.538451 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.538431    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:09:49.538552 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.538502    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:09:49.560971 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.560948    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"]
Jul 02 19:09:49.632936 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.632894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.632936 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.632934    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.633219 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.632958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.633219 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.632990    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.633219 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.633082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wjzm\" (UniqueName: \"kubernetes.io/projected/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-kube-api-access-7wjzm\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.734034 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.733980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wjzm\" (UniqueName: \"kubernetes.io/projected/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-kube-api-access-7wjzm\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.734216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.734051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.734216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.734077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.734216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.734101    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.734216 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.734128    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.734550 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.734520    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-manifests\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.736452 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.736422    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-tmp\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.736665 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.736646    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.736708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.736663    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.750664 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.750646    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wjzm\" (UniqueName: \"kubernetes.io/projected/6b4d879c-6bef-44f4-afd4-d4a18a3e96fc-kube-api-access-7wjzm\") pod \"opendatahub-operator-controller-manager-d984f5d94-psvtf\" (UID: \"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc\") " pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.844091 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.844067    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:49.987489 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:49.987458    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"]
Jul 02 19:09:49.991738 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:09:49.991709    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4d879c_6bef_44f4_afd4_d4a18a3e96fc.slice/crio-bdf43d7480d2f7ebdc9adf8e72f5eb44c6c5eee8d0f47bed813904db61b1d967 WatchSource:0}: Error finding container bdf43d7480d2f7ebdc9adf8e72f5eb44c6c5eee8d0f47bed813904db61b1d967: Status 404 returned error can't find the container with id bdf43d7480d2f7ebdc9adf8e72f5eb44c6c5eee8d0f47bed813904db61b1d967
Jul 02 19:09:50.764531 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:50.764496    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf" event={"ID":"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc","Type":"ContainerStarted","Data":"bdf43d7480d2f7ebdc9adf8e72f5eb44c6c5eee8d0f47bed813904db61b1d967"}
Jul 02 19:09:53.778653 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:53.778571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf" event={"ID":"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc","Type":"ContainerStarted","Data":"5a00dd4eb550565da44eeadd9d251dac08607b759701da9fbeed2f71dc8c3fb9"}
Jul 02 19:09:54.784166 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:54.784130    2567 generic.go:356] "Generic (PLEG): container finished" podID="6b4d879c-6bef-44f4-afd4-d4a18a3e96fc" containerID="5a00dd4eb550565da44eeadd9d251dac08607b759701da9fbeed2f71dc8c3fb9" exitCode=0
Jul 02 19:09:54.784525 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:54.784172    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf" event={"ID":"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc","Type":"ContainerDied","Data":"5a00dd4eb550565da44eeadd9d251dac08607b759701da9fbeed2f71dc8c3fb9"}
Jul 02 19:09:55.790003 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:55.789964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf" event={"ID":"6b4d879c-6bef-44f4-afd4-d4a18a3e96fc","Type":"ContainerStarted","Data":"c760db87349694d1a33c77fecd4f3e15b9463f6949d89d629f8e759938b26b5e"}
Jul 02 19:09:55.790414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:55.790141    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:09:55.817993 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:09:55.817946    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf" podStartSLOduration=1.787365989 podStartE2EDuration="6.817931013s" totalImagesPullingTime="3.982239099s" totalInitContainerRuntime="1.048325925s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:55.816460034 +0000 UTC m=+522.434186104" watchObservedRunningTime="2026-07-02 19:09:55.817931013 +0000 UTC m=+522.435657092"
Jul 02 19:10:06.796173 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:06.796093    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d984f5d94-psvtf"
Jul 02 19:10:10.258278 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.258246    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-595b598896-tsw88"]
Jul 02 19:10:10.261337 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.261320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.264400 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.264376    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:10:10.264400 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.264392    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:10:10.265395 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.265376    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:10:10.265395 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.265390    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:10:10.288274 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.288247    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-595b598896-tsw88"]
Jul 02 19:10:10.308632 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.308612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd000c7-3bf1-4b8c-b091-17d499a0f857-tls-certs\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.308732 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.308639    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pkq\" (UniqueName: \"kubernetes.io/projected/acd000c7-3bf1-4b8c-b091-17d499a0f857-kube-api-access-x2pkq\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.308732 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.308670    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd000c7-3bf1-4b8c-b091-17d499a0f857-tmp\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.409375 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.409332    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd000c7-3bf1-4b8c-b091-17d499a0f857-tmp\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.409582 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.409434    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd000c7-3bf1-4b8c-b091-17d499a0f857-tls-certs\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.409582 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.409459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pkq\" (UniqueName: \"kubernetes.io/projected/acd000c7-3bf1-4b8c-b091-17d499a0f857-kube-api-access-x2pkq\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.411718 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.411692    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd000c7-3bf1-4b8c-b091-17d499a0f857-tmp\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.411831 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.411804    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acd000c7-3bf1-4b8c-b091-17d499a0f857-tls-certs\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.426836 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.426800    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pkq\" (UniqueName: \"kubernetes.io/projected/acd000c7-3bf1-4b8c-b091-17d499a0f857-kube-api-access-x2pkq\") pod \"kube-auth-proxy-595b598896-tsw88\" (UID: \"acd000c7-3bf1-4b8c-b091-17d499a0f857\") " pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.571306 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.571222    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-df9gs"]
Jul 02 19:10:10.571465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.571326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88"
Jul 02 19:10:10.574756 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.574724    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:10.610348 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.610312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-cert\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:10.610469 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.610373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvvhz\" (UniqueName: \"kubernetes.io/projected/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-kube-api-access-mvvhz\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:10.622663 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.622618    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 19:10:10.623249 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.623227    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9p22k\""
Jul 02 19:10:10.661965 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.661726    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-df9gs"]
Jul 02 19:10:10.710933 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.710897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-cert\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:10.711125 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.711005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvvhz\" (UniqueName: \"kubernetes.io/projected/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-kube-api-access-mvvhz\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:10.711125 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:10:10.711066    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 02 19:10:10.711246 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:10:10.711136    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-cert podName:614b9b98-7011-4ca5-b7ea-7d0102ae3a1d nodeName:}" failed. No retries permitted until 2026-07-02 19:10:11.211115827 +0000 UTC m=+537.828841882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-cert") pod "odh-model-controller-7998c67dc4-df9gs" (UID: "614b9b98-7011-4ca5-b7ea-7d0102ae3a1d") : secret "odh-model-controller-webhook-cert" not found
Jul 02 19:10:10.730964 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.730797    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-595b598896-tsw88"]
Jul 02 19:10:10.733216 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:10:10.733192    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd000c7_3bf1_4b8c_b091_17d499a0f857.slice/crio-5bd8a8a367e45c6d814cf6268bd1619c441967b580ba17fc2f8f38a590211130 WatchSource:0}: Error finding container 5bd8a8a367e45c6d814cf6268bd1619c441967b580ba17fc2f8f38a590211130: Status 404 returned error can't find the container with id 5bd8a8a367e45c6d814cf6268bd1619c441967b580ba17fc2f8f38a590211130
Jul 02 19:10:10.733844 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.733822    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvvhz\" (UniqueName: \"kubernetes.io/projected/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-kube-api-access-mvvhz\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:10.851801 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.851715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88" event={"ID":"acd000c7-3bf1-4b8c-b091-17d499a0f857","Type":"ContainerStarted","Data":"5bd8a8a367e45c6d814cf6268bd1619c441967b580ba17fc2f8f38a590211130"}
Jul 02 19:10:10.932795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.932758    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"]
Jul 02 19:10:10.937185 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.937158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:10.941378 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.941328    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 19:10:10.941917 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.941741    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:10:10.942047 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.941978    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 19:10:10.942384 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.942244    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g56hx\""
Jul 02 19:10:10.942384 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.942269    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 19:10:10.942529 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.942476    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:10:10.969772 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:10.969736    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"]
Jul 02 19:10:11.018578 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.018548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkfv2\" (UniqueName: \"kubernetes.io/projected/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-kube-api-access-kkfv2\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.018740 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.018583    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-metrics-cert\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.018740 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.018662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-cert\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.018740 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.018681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-manager-config\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.119448 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.119370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkfv2\" (UniqueName: \"kubernetes.io/projected/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-kube-api-access-kkfv2\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.119448 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.119405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-metrics-cert\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.119448 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.119448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-cert\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.119720 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.119468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-manager-config\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.120231 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.120205    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-manager-config\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.121934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.121915    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-metrics-cert\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.122005 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.121931    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-cert\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.132558 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.132518    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkfv2\" (UniqueName: \"kubernetes.io/projected/abd9e2f0-d72d-41e3-8bb5-9b89d2680b10-kube-api-access-kkfv2\") pod \"lws-controller-manager-7965745c7f-4r5rd\" (UID: \"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10\") " pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.220403 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.220372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-cert\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:11.222719 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.222691    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/614b9b98-7011-4ca5-b7ea-7d0102ae3a1d-cert\") pod \"odh-model-controller-7998c67dc4-df9gs\" (UID: \"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d\") " pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:11.250462 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.250428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:11.421639 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.421281    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"]
Jul 02 19:10:11.425643 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:10:11.425599    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd9e2f0_d72d_41e3_8bb5_9b89d2680b10.slice/crio-cf683dfc422ddb0d248f71006a9d5bc98bd281e4b414620aabb0c8929d4500be WatchSource:0}: Error finding container cf683dfc422ddb0d248f71006a9d5bc98bd281e4b414620aabb0c8929d4500be: Status 404 returned error can't find the container with id cf683dfc422ddb0d248f71006a9d5bc98bd281e4b414620aabb0c8929d4500be
Jul 02 19:10:11.499634 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.499595    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:11.672887 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.672793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-df9gs"]
Jul 02 19:10:11.678432 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:10:11.678220    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614b9b98_7011_4ca5_b7ea_7d0102ae3a1d.slice/crio-50b2fd3eb5bac773de2f6e34f9e2daae972d2fb888727ff5e19cd28a184f8cef WatchSource:0}: Error finding container 50b2fd3eb5bac773de2f6e34f9e2daae972d2fb888727ff5e19cd28a184f8cef: Status 404 returned error can't find the container with id 50b2fd3eb5bac773de2f6e34f9e2daae972d2fb888727ff5e19cd28a184f8cef
Jul 02 19:10:11.861751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.861672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd" event={"ID":"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10","Type":"ContainerStarted","Data":"cf683dfc422ddb0d248f71006a9d5bc98bd281e4b414620aabb0c8929d4500be"}
Jul 02 19:10:11.863072 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:11.863042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs" event={"ID":"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d","Type":"ContainerStarted","Data":"50b2fd3eb5bac773de2f6e34f9e2daae972d2fb888727ff5e19cd28a184f8cef"}
Jul 02 19:10:16.620638 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.620521    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:10:16.897243 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.897202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88" event={"ID":"acd000c7-3bf1-4b8c-b091-17d499a0f857","Type":"ContainerStarted","Data":"c7e7ea523c64c8eb82e0973d2211a760f30e22dc8fc0cc8b8028a4da73378230"}
Jul 02 19:10:16.898750 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.898718    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd" event={"ID":"abd9e2f0-d72d-41e3-8bb5-9b89d2680b10","Type":"ContainerStarted","Data":"ce9b5dd956b8834a561852b1e32e0ebc76139b3f708047bbfebe6fabf90891d4"}
Jul 02 19:10:16.898900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.898819    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:16.900254 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.900232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs" event={"ID":"614b9b98-7011-4ca5-b7ea-7d0102ae3a1d","Type":"ContainerStarted","Data":"2ff2cffa0df23e9696c5070011297cf893e6b054c0e71b1f8f77d57d12344950"}
Jul 02 19:10:16.900383 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.900368    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:10:16.933729 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.933680    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-595b598896-tsw88" podStartSLOduration=1.051036295 podStartE2EDuration="6.933663796s" totalImagesPullingTime="5.882627501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:16.932622475 +0000 UTC m=+543.550348555" watchObservedRunningTime="2026-07-02 19:10:16.933663796 +0000 UTC m=+543.551389877"
Jul 02 19:10:16.980286 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:16.980237    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd" podStartSLOduration=1.786900287 podStartE2EDuration="6.980220823s" totalImagesPullingTime="5.193320536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:16.979327496 +0000 UTC m=+543.597053576" watchObservedRunningTime="2026-07-02 19:10:16.980220823 +0000 UTC m=+543.597946901"
Jul 02 19:10:17.035511 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:17.035454    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs" podStartSLOduration=2.034694409 podStartE2EDuration="7.035431517s" totalImagesPullingTime="5.000737108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:10:17.034137292 +0000 UTC m=+543.651863394" watchObservedRunningTime="2026-07-02 19:10:17.035431517 +0000 UTC m=+543.653157595"
Jul 02 19:10:27.906604 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:27.906571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7965745c7f-4r5rd"
Jul 02 19:10:27.907128 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:10:27.906648    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-df9gs"
Jul 02 19:11:13.814313 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:11:13.814273    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:11:13.815561 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:11:13.815541    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:11:13.818696 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:11:13.818680    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:11:13.819748 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:11:13.819732    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:12:03.694369 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.694334    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"]
Jul 02 19:12:03.696775 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.696760    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:03.699758 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.699733    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68jph\""
Jul 02 19:12:03.699872 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.699804    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:12:03.700181 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.700163    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:12:03.712875 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.712853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"]
Jul 02 19:12:03.814247 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.814209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjp65\" (UniqueName: \"kubernetes.io/projected/79940e9d-769f-4c63-bfd3-aee2162cc660-kube-api-access-jjp65\") pod \"kuadrant-operator-controller-manager-86878c769f-pb4td\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:03.814427 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.814327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79940e9d-769f-4c63-bfd3-aee2162cc660-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pb4td\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:03.915253 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.915209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79940e9d-769f-4c63-bfd3-aee2162cc660-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pb4td\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:03.915460 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.915304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjp65\" (UniqueName: \"kubernetes.io/projected/79940e9d-769f-4c63-bfd3-aee2162cc660-kube-api-access-jjp65\") pod \"kuadrant-operator-controller-manager-86878c769f-pb4td\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:03.915651 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.915625    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79940e9d-769f-4c63-bfd3-aee2162cc660-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pb4td\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:03.935135 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:03.935106    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjp65\" (UniqueName: \"kubernetes.io/projected/79940e9d-769f-4c63-bfd3-aee2162cc660-kube-api-access-jjp65\") pod \"kuadrant-operator-controller-manager-86878c769f-pb4td\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:04.007721 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:04.007643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:04.148153 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:04.148123    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"]
Jul 02 19:12:04.150639 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:12:04.150607    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79940e9d_769f_4c63_bfd3_aee2162cc660.slice/crio-1a719ba0e82f39973d299906c34f60b4290a99fdb87e7e574310cc81d716f7e3 WatchSource:0}: Error finding container 1a719ba0e82f39973d299906c34f60b4290a99fdb87e7e574310cc81d716f7e3: Status 404 returned error can't find the container with id 1a719ba0e82f39973d299906c34f60b4290a99fdb87e7e574310cc81d716f7e3
Jul 02 19:12:04.153037 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:04.153005    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:12:04.366613 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:04.366524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td" event={"ID":"79940e9d-769f-4c63-bfd3-aee2162cc660","Type":"ContainerStarted","Data":"1a719ba0e82f39973d299906c34f60b4290a99fdb87e7e574310cc81d716f7e3"}
Jul 02 19:12:09.390059 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:09.390004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td" event={"ID":"79940e9d-769f-4c63-bfd3-aee2162cc660","Type":"ContainerStarted","Data":"a63bff86ecab0270ad882772378bcc86439b4e17675b940e521114a0b20e3794"}
Jul 02 19:12:09.390443 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:09.390112    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:09.416329 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:09.416281    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td" podStartSLOduration=1.5975862570000001 podStartE2EDuration="6.416266685s" totalImagesPullingTime="4.818680428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:09.41425033 +0000 UTC m=+656.031976419" watchObservedRunningTime="2026-07-02 19:12:09.416266685 +0000 UTC m=+656.033992763"
Jul 02 19:12:20.396695 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:20.396661    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:12:42.068679 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.068644    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jmfsc"]
Jul 02 19:12:42.071953 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.071929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:42.074671 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.074639    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w8kxj\""
Jul 02 19:12:42.079366 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.079342    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jmfsc"]
Jul 02 19:12:42.156761 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.156725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97k2l\" (UniqueName: \"kubernetes.io/projected/519c1dbe-6f42-460f-a315-82a7b340889b-kube-api-access-97k2l\") pod \"authorino-58cd955675-jmfsc\" (UID: \"519c1dbe-6f42-460f-a315-82a7b340889b\") " pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:42.230163 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.230133    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-h5cw6"]
Jul 02 19:12:42.232456 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.232434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:12:42.241501 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.241474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h5cw6"]
Jul 02 19:12:42.257859 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.257832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k2l\" (UniqueName: \"kubernetes.io/projected/519c1dbe-6f42-460f-a315-82a7b340889b-kube-api-access-97k2l\") pod \"authorino-58cd955675-jmfsc\" (UID: \"519c1dbe-6f42-460f-a315-82a7b340889b\") " pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:42.265999 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.265971    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97k2l\" (UniqueName: \"kubernetes.io/projected/519c1dbe-6f42-460f-a315-82a7b340889b-kube-api-access-97k2l\") pod \"authorino-58cd955675-jmfsc\" (UID: \"519c1dbe-6f42-460f-a315-82a7b340889b\") " pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:42.359070 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.358953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpzwv\" (UniqueName: \"kubernetes.io/projected/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527-kube-api-access-jpzwv\") pod \"authorino-75d556bd77-h5cw6\" (UID: \"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527\") " pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:12:42.381839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.381810    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:42.460446 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.460171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpzwv\" (UniqueName: \"kubernetes.io/projected/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527-kube-api-access-jpzwv\") pod \"authorino-75d556bd77-h5cw6\" (UID: \"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527\") " pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:12:42.468508 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.468477    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpzwv\" (UniqueName: \"kubernetes.io/projected/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527-kube-api-access-jpzwv\") pod \"authorino-75d556bd77-h5cw6\" (UID: \"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527\") " pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:12:42.506436 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.506410    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jmfsc"]
Jul 02 19:12:42.508157 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:12:42.508131    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod519c1dbe_6f42_460f_a315_82a7b340889b.slice/crio-1c082a32488d74f44e4a5d6ac574f0b188752c5d281ccc8a88903331ca7bf7bc WatchSource:0}: Error finding container 1c082a32488d74f44e4a5d6ac574f0b188752c5d281ccc8a88903331ca7bf7bc: Status 404 returned error can't find the container with id 1c082a32488d74f44e4a5d6ac574f0b188752c5d281ccc8a88903331ca7bf7bc
Jul 02 19:12:42.533591 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.533564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jmfsc" event={"ID":"519c1dbe-6f42-460f-a315-82a7b340889b","Type":"ContainerStarted","Data":"1c082a32488d74f44e4a5d6ac574f0b188752c5d281ccc8a88903331ca7bf7bc"}
Jul 02 19:12:42.541714 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.541698    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:12:42.662856 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:42.662832    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h5cw6"]
Jul 02 19:12:42.664734 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:12:42.664708    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1dfe37f_9abb_40b2_8c4f_c97dc2f60527.slice/crio-c1756c013fc86e4569bc1269e78ba00e5ffe391e4d5f278be319f527a6373809 WatchSource:0}: Error finding container c1756c013fc86e4569bc1269e78ba00e5ffe391e4d5f278be319f527a6373809: Status 404 returned error can't find the container with id c1756c013fc86e4569bc1269e78ba00e5ffe391e4d5f278be319f527a6373809
Jul 02 19:12:43.547465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:43.547363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h5cw6" event={"ID":"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527","Type":"ContainerStarted","Data":"c1756c013fc86e4569bc1269e78ba00e5ffe391e4d5f278be319f527a6373809"}
Jul 02 19:12:46.562715 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:46.562675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jmfsc" event={"ID":"519c1dbe-6f42-460f-a315-82a7b340889b","Type":"ContainerStarted","Data":"a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f"}
Jul 02 19:12:46.564157 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:46.564129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h5cw6" event={"ID":"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527","Type":"ContainerStarted","Data":"f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b"}
Jul 02 19:12:46.580512 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:46.580469    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jmfsc" podStartSLOduration=1.335683471 podStartE2EDuration="4.580455137s" totalImagesPullingTime="3.244771666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:46.579807129 +0000 UTC m=+693.197533207" watchObservedRunningTime="2026-07-02 19:12:46.580455137 +0000 UTC m=+693.198181219"
Jul 02 19:12:46.596850 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:46.596798    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-h5cw6" podStartSLOduration=1.50453516 podStartE2EDuration="4.596779457s" totalImagesPullingTime="3.092244297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:46.594897897 +0000 UTC m=+693.212623977" watchObservedRunningTime="2026-07-02 19:12:46.596779457 +0000 UTC m=+693.214505536"
Jul 02 19:12:46.625472 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:46.625442    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jmfsc"]
Jul 02 19:12:48.574030 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:48.573986    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jmfsc" podUID="519c1dbe-6f42-460f-a315-82a7b340889b" containerName="authorino" containerID="cri-o://a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f" gracePeriod=30
Jul 02 19:12:48.818299 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:48.818277    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:48.919900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:48.919872    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97k2l\" (UniqueName: \"kubernetes.io/projected/519c1dbe-6f42-460f-a315-82a7b340889b-kube-api-access-97k2l\") pod \"519c1dbe-6f42-460f-a315-82a7b340889b\" (UID: \"519c1dbe-6f42-460f-a315-82a7b340889b\") "
Jul 02 19:12:48.922066 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:48.922027    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519c1dbe-6f42-460f-a315-82a7b340889b-kube-api-access-97k2l" (OuterVolumeSpecName: "kube-api-access-97k2l") pod "519c1dbe-6f42-460f-a315-82a7b340889b" (UID: "519c1dbe-6f42-460f-a315-82a7b340889b"). InnerVolumeSpecName "kube-api-access-97k2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:49.021403 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.021367    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97k2l\" (UniqueName: \"kubernetes.io/projected/519c1dbe-6f42-460f-a315-82a7b340889b-kube-api-access-97k2l\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:12:49.579475 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.579435    2567 generic.go:356] "Generic (PLEG): container finished" podID="519c1dbe-6f42-460f-a315-82a7b340889b" containerID="a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f" exitCode=0
Jul 02 19:12:49.579475 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.579475    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jmfsc"
Jul 02 19:12:49.579945 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.579518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jmfsc" event={"ID":"519c1dbe-6f42-460f-a315-82a7b340889b","Type":"ContainerDied","Data":"a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f"}
Jul 02 19:12:49.579945 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.579560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jmfsc" event={"ID":"519c1dbe-6f42-460f-a315-82a7b340889b","Type":"ContainerDied","Data":"1c082a32488d74f44e4a5d6ac574f0b188752c5d281ccc8a88903331ca7bf7bc"}
Jul 02 19:12:49.579945 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.579579    2567 scope.go:117] "RemoveContainer" containerID="a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f"
Jul 02 19:12:49.588227 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.588208    2567 scope.go:117] "RemoveContainer" containerID="a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f"
Jul 02 19:12:49.588493 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:12:49.588475    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f\": container with ID starting with a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f not found: ID does not exist" containerID="a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f"
Jul 02 19:12:49.588566 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.588502    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f"} err="failed to get container status \"a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f\": rpc error: code = NotFound desc = could not find container \"a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f\": container with ID starting with a3296c9d5be83e26bbc6ecc1f2e4424285b54434b997f435ee8b2ea008b6607f not found: ID does not exist"
Jul 02 19:12:49.599722 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.599692    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jmfsc"]
Jul 02 19:12:49.603195 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.603173    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jmfsc"]
Jul 02 19:12:49.939667 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:12:49.939634    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519c1dbe-6f42-460f-a315-82a7b340889b" path="/var/lib/kubelet/pods/519c1dbe-6f42-460f-a315-82a7b340889b/volumes"
Jul 02 19:13:15.879685 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.879653    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqlpd"]
Jul 02 19:13:15.880105 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.879990    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519c1dbe-6f42-460f-a315-82a7b340889b" containerName="authorino"
Jul 02 19:13:15.880105 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.880003    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="519c1dbe-6f42-460f-a315-82a7b340889b" containerName="authorino"
Jul 02 19:13:15.880105 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.880095    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="519c1dbe-6f42-460f-a315-82a7b340889b" containerName="authorino"
Jul 02 19:13:15.882831 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.882802    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:15.889868 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.889830    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqlpd"]
Jul 02 19:13:15.953991 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:15.953961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9mwr\" (UniqueName: \"kubernetes.io/projected/31d07543-f380-4173-9900-264a166d2cec-kube-api-access-n9mwr\") pod \"authorino-5d4b67c446-hqlpd\" (UID: \"31d07543-f380-4173-9900-264a166d2cec\") " pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:16.054848 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.054817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mwr\" (UniqueName: \"kubernetes.io/projected/31d07543-f380-4173-9900-264a166d2cec-kube-api-access-n9mwr\") pod \"authorino-5d4b67c446-hqlpd\" (UID: \"31d07543-f380-4173-9900-264a166d2cec\") " pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:16.063353 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.063321    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9mwr\" (UniqueName: \"kubernetes.io/projected/31d07543-f380-4173-9900-264a166d2cec-kube-api-access-n9mwr\") pod \"authorino-5d4b67c446-hqlpd\" (UID: \"31d07543-f380-4173-9900-264a166d2cec\") " pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:16.123317 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.123287    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqlpd"]
Jul 02 19:13:16.123563 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.123548    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:16.143793 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.143766    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-676d998bf9-hhfck"]
Jul 02 19:13:16.146268 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.146249    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:16.154341 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.154264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-676d998bf9-hhfck"]
Jul 02 19:13:16.174646 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.174591    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-676d998bf9-hhfck"]
Jul 02 19:13:16.174912 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:13:16.174884    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jz9df], unattached volumes=[], failed to process volumes=[kube-api-access-jz9df]: context canceled" pod="kuadrant-system/authorino-676d998bf9-hhfck" podUID="09cae6de-ce10-4c0d-b3dc-659a73d893e1"
Jul 02 19:13:16.204299 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.204270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68ccb57955-2d6tk"]
Jul 02 19:13:16.206502 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.206480    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.209174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.209106    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 19:13:16.214584 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.214526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68ccb57955-2d6tk"]
Jul 02 19:13:16.256606 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.256572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-tls-cert\") pod \"authorino-68ccb57955-2d6tk\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") " pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.256754 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.256615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqwl\" (UniqueName: \"kubernetes.io/projected/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-kube-api-access-8kqwl\") pod \"authorino-68ccb57955-2d6tk\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") " pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.256754 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.256648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9df\" (UniqueName: \"kubernetes.io/projected/09cae6de-ce10-4c0d-b3dc-659a73d893e1-kube-api-access-jz9df\") pod \"authorino-676d998bf9-hhfck\" (UID: \"09cae6de-ce10-4c0d-b3dc-659a73d893e1\") " pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:16.267026 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.266936    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqlpd"]
Jul 02 19:13:16.269123 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:13:16.269095    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31d07543_f380_4173_9900_264a166d2cec.slice/crio-2a7c0eaafd48308398b60bf562fb000f983a1539deaacaf410fa23933198e69f WatchSource:0}: Error finding container 2a7c0eaafd48308398b60bf562fb000f983a1539deaacaf410fa23933198e69f: Status 404 returned error can't find the container with id 2a7c0eaafd48308398b60bf562fb000f983a1539deaacaf410fa23933198e69f
Jul 02 19:13:16.358083 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.358044    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-tls-cert\") pod \"authorino-68ccb57955-2d6tk\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") " pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.358258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.358112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqwl\" (UniqueName: \"kubernetes.io/projected/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-kube-api-access-8kqwl\") pod \"authorino-68ccb57955-2d6tk\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") " pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.358258 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.358154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9df\" (UniqueName: \"kubernetes.io/projected/09cae6de-ce10-4c0d-b3dc-659a73d893e1-kube-api-access-jz9df\") pod \"authorino-676d998bf9-hhfck\" (UID: \"09cae6de-ce10-4c0d-b3dc-659a73d893e1\") " pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:16.360476 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.360454    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-tls-cert\") pod \"authorino-68ccb57955-2d6tk\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") " pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.366766 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.366742    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqwl\" (UniqueName: \"kubernetes.io/projected/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-kube-api-access-8kqwl\") pod \"authorino-68ccb57955-2d6tk\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") " pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.367064 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.367045    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9df\" (UniqueName: \"kubernetes.io/projected/09cae6de-ce10-4c0d-b3dc-659a73d893e1-kube-api-access-jz9df\") pod \"authorino-676d998bf9-hhfck\" (UID: \"09cae6de-ce10-4c0d-b3dc-659a73d893e1\") " pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:16.517538 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.517461    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:13:16.642770 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.642748    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68ccb57955-2d6tk"]
Jul 02 19:13:16.644531 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:13:16.644500    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf802d39a_a8e9_4af2_b93c_e5861a4ba24d.slice/crio-be3fdccf869c67919408f9ba85ce7b25829d142afb232881c28361977a0fb5c0 WatchSource:0}: Error finding container be3fdccf869c67919408f9ba85ce7b25829d142afb232881c28361977a0fb5c0: Status 404 returned error can't find the container with id be3fdccf869c67919408f9ba85ce7b25829d142afb232881c28361977a0fb5c0
Jul 02 19:13:16.706169 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.706136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ccb57955-2d6tk" event={"ID":"f802d39a-a8e9-4af2-b93c-e5861a4ba24d","Type":"ContainerStarted","Data":"be3fdccf869c67919408f9ba85ce7b25829d142afb232881c28361977a0fb5c0"}
Jul 02 19:13:16.707103 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.707070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqlpd" event={"ID":"31d07543-f380-4173-9900-264a166d2cec","Type":"ContainerStarted","Data":"2a7c0eaafd48308398b60bf562fb000f983a1539deaacaf410fa23933198e69f"}
Jul 02 19:13:16.707103 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.707094    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:16.713447 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.713430    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:16.762541 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.762516    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz9df\" (UniqueName: \"kubernetes.io/projected/09cae6de-ce10-4c0d-b3dc-659a73d893e1-kube-api-access-jz9df\") pod \"09cae6de-ce10-4c0d-b3dc-659a73d893e1\" (UID: \"09cae6de-ce10-4c0d-b3dc-659a73d893e1\") "
Jul 02 19:13:16.764385 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.764364    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09cae6de-ce10-4c0d-b3dc-659a73d893e1-kube-api-access-jz9df" (OuterVolumeSpecName: "kube-api-access-jz9df") pod "09cae6de-ce10-4c0d-b3dc-659a73d893e1" (UID: "09cae6de-ce10-4c0d-b3dc-659a73d893e1"). InnerVolumeSpecName "kube-api-access-jz9df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:16.863928 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:16.863892    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz9df\" (UniqueName: \"kubernetes.io/projected/09cae6de-ce10-4c0d-b3dc-659a73d893e1-kube-api-access-jz9df\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:13:17.713371 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.713322    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqlpd" event={"ID":"31d07543-f380-4173-9900-264a166d2cec","Type":"ContainerStarted","Data":"792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706"}
Jul 02 19:13:17.713371 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.713322    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hqlpd" podUID="31d07543-f380-4173-9900-264a166d2cec" containerName="authorino" containerID="cri-o://792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706" gracePeriod=30
Jul 02 19:13:17.714840 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.714820    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-676d998bf9-hhfck"
Jul 02 19:13:17.714933 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.714819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ccb57955-2d6tk" event={"ID":"f802d39a-a8e9-4af2-b93c-e5861a4ba24d","Type":"ContainerStarted","Data":"2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7"}
Jul 02 19:13:17.728318 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.728269    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hqlpd" podStartSLOduration=2.260109135 podStartE2EDuration="2.728251375s" totalImagesPullingTime="468.14224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:17.728105351 +0000 UTC m=+724.345831430" watchObservedRunningTime="2026-07-02 19:13:17.728251375 +0000 UTC m=+724.345977454"
Jul 02 19:13:17.748691 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.748648    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68ccb57955-2d6tk" podStartSLOduration=1.379598897 podStartE2EDuration="1.748634114s" totalImagesPullingTime="369.035217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:13:17.748172835 +0000 UTC m=+724.365898914" watchObservedRunningTime="2026-07-02 19:13:17.748634114 +0000 UTC m=+724.366360192"
Jul 02 19:13:17.775002 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.774973    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h5cw6"]
Jul 02 19:13:17.775205 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.775184    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-h5cw6" podUID="c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" containerName="authorino" containerID="cri-o://f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b" gracePeriod=30
Jul 02 19:13:17.790622 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.790593    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-676d998bf9-hhfck"]
Jul 02 19:13:17.795605 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.795579    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-676d998bf9-hhfck"]
Jul 02 19:13:17.947340 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:17.947310    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09cae6de-ce10-4c0d-b3dc-659a73d893e1" path="/var/lib/kubelet/pods/09cae6de-ce10-4c0d-b3dc-659a73d893e1/volumes"
Jul 02 19:13:18.032840 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.032818    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:18.035769 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.035752    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:13:18.176152 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.176117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9mwr\" (UniqueName: \"kubernetes.io/projected/31d07543-f380-4173-9900-264a166d2cec-kube-api-access-n9mwr\") pod \"31d07543-f380-4173-9900-264a166d2cec\" (UID: \"31d07543-f380-4173-9900-264a166d2cec\") "
Jul 02 19:13:18.176347 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.176198    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpzwv\" (UniqueName: \"kubernetes.io/projected/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527-kube-api-access-jpzwv\") pod \"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527\" (UID: \"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527\") "
Jul 02 19:13:18.178283 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.178246    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d07543-f380-4173-9900-264a166d2cec-kube-api-access-n9mwr" (OuterVolumeSpecName: "kube-api-access-n9mwr") pod "31d07543-f380-4173-9900-264a166d2cec" (UID: "31d07543-f380-4173-9900-264a166d2cec"). InnerVolumeSpecName "kube-api-access-n9mwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:18.178403 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.178352    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527-kube-api-access-jpzwv" (OuterVolumeSpecName: "kube-api-access-jpzwv") pod "c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" (UID: "c1dfe37f-9abb-40b2-8c4f-c97dc2f60527"). InnerVolumeSpecName "kube-api-access-jpzwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:18.277601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.277519    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9mwr\" (UniqueName: \"kubernetes.io/projected/31d07543-f380-4173-9900-264a166d2cec-kube-api-access-n9mwr\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:13:18.277601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.277552    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpzwv\" (UniqueName: \"kubernetes.io/projected/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527-kube-api-access-jpzwv\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:13:18.720271 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.720242    2567 generic.go:356] "Generic (PLEG): container finished" podID="31d07543-f380-4173-9900-264a166d2cec" containerID="792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706" exitCode=0
Jul 02 19:13:18.720744 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.720281    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hqlpd"
Jul 02 19:13:18.720744 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.720331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqlpd" event={"ID":"31d07543-f380-4173-9900-264a166d2cec","Type":"ContainerDied","Data":"792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706"}
Jul 02 19:13:18.720744 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.720377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hqlpd" event={"ID":"31d07543-f380-4173-9900-264a166d2cec","Type":"ContainerDied","Data":"2a7c0eaafd48308398b60bf562fb000f983a1539deaacaf410fa23933198e69f"}
Jul 02 19:13:18.720744 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.720402    2567 scope.go:117] "RemoveContainer" containerID="792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706"
Jul 02 19:13:18.721741 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.721641    2567 generic.go:356] "Generic (PLEG): container finished" podID="c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" containerID="f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b" exitCode=0
Jul 02 19:13:18.721741 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.721668    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h5cw6"
Jul 02 19:13:18.721741 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.721722    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h5cw6" event={"ID":"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527","Type":"ContainerDied","Data":"f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b"}
Jul 02 19:13:18.721903 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.721756    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h5cw6" event={"ID":"c1dfe37f-9abb-40b2-8c4f-c97dc2f60527","Type":"ContainerDied","Data":"c1756c013fc86e4569bc1269e78ba00e5ffe391e4d5f278be319f527a6373809"}
Jul 02 19:13:18.729617 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.729548    2567 scope.go:117] "RemoveContainer" containerID="792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706"
Jul 02 19:13:18.729894 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:13:18.729867    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706\": container with ID starting with 792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706 not found: ID does not exist" containerID="792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706"
Jul 02 19:13:18.729987 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.729902    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706"} err="failed to get container status \"792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706\": rpc error: code = NotFound desc = could not find container \"792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706\": container with ID starting with 792d31c0c981e056d52b2666f54ad9dfce1eab041d09ed6009dcec3fd89c8706 not found: ID does not exist"
Jul 02 19:13:18.729987 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.729925    2567 scope.go:117] "RemoveContainer" containerID="f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b"
Jul 02 19:13:18.737581 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.737562    2567 scope.go:117] "RemoveContainer" containerID="f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b"
Jul 02 19:13:18.737825 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:13:18.737806    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b\": container with ID starting with f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b not found: ID does not exist" containerID="f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b"
Jul 02 19:13:18.737880 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.737831    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b"} err="failed to get container status \"f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b\": rpc error: code = NotFound desc = could not find container \"f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b\": container with ID starting with f858cc8a9d64c82c0bfd024c8888630f2b10338be3d6ca9729208729952f658b not found: ID does not exist"
Jul 02 19:13:18.743554 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.743533    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h5cw6"]
Jul 02 19:13:18.747236 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.747219    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h5cw6"]
Jul 02 19:13:18.757469 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.757441    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqlpd"]
Jul 02 19:13:18.758858 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:18.758836    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hqlpd"]
Jul 02 19:13:19.939246 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:19.939219    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d07543-f380-4173-9900-264a166d2cec" path="/var/lib/kubelet/pods/31d07543-f380-4173-9900-264a166d2cec/volumes"
Jul 02 19:13:19.939682 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:13:19.939528    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" path="/var/lib/kubelet/pods/c1dfe37f-9abb-40b2-8c4f-c97dc2f60527/volumes"
Jul 02 19:14:39.872203 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872122    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"]
Jul 02 19:14:39.872616 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872466    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" containerName="authorino"
Jul 02 19:14:39.872616 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872477    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" containerName="authorino"
Jul 02 19:14:39.872616 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872485    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d07543-f380-4173-9900-264a166d2cec" containerName="authorino"
Jul 02 19:14:39.872616 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872491    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d07543-f380-4173-9900-264a166d2cec" containerName="authorino"
Jul 02 19:14:39.872616 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872541    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="31d07543-f380-4173-9900-264a166d2cec" containerName="authorino"
Jul 02 19:14:39.872616 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.872560    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1dfe37f-9abb-40b2-8c4f-c97dc2f60527" containerName="authorino"
Jul 02 19:14:39.875523 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.875502    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.878192 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.878167    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 19:14:39.879179 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.879160    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwxgv\""
Jul 02 19:14:39.879284 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.879187    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 19:14:39.879284 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.879213    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 19:14:39.887512 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.887481    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.887677 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.887659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.887791 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.887778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.887906 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.887883    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5319a1b8-89ca-4450-bb1b-8813cee83ab8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.888050 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.887926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhq6\" (UniqueName: \"kubernetes.io/projected/5319a1b8-89ca-4450-bb1b-8813cee83ab8-kube-api-access-zlhq6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.888050 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.887962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.892487 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.888260    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"]
Jul 02 19:14:39.988964 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.988926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.988964 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.988967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.988988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.989041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5319a1b8-89ca-4450-bb1b-8813cee83ab8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.989075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhq6\" (UniqueName: \"kubernetes.io/projected/5319a1b8-89ca-4450-bb1b-8813cee83ab8-kube-api-access-zlhq6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989220 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.989206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989455 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.989436    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989514 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.989483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.989649 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.989633    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.991153 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.991129    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5319a1b8-89ca-4450-bb1b-8813cee83ab8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.991467 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.991449    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5319a1b8-89ca-4450-bb1b-8813cee83ab8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:39.997699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:39.997676    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhq6\" (UniqueName: \"kubernetes.io/projected/5319a1b8-89ca-4450-bb1b-8813cee83ab8-kube-api-access-zlhq6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rlsnf\" (UID: \"5319a1b8-89ca-4450-bb1b-8813cee83ab8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:40.187349 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:40.187316    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:40.322369 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:40.322345    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"]
Jul 02 19:14:40.324154 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:14:40.324125    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5319a1b8_89ca_4450_bb1b_8813cee83ab8.slice/crio-8b49fbf9304a12451402bf92f8996ad2c56f201e6a441c05c52e806832d80e08 WatchSource:0}: Error finding container 8b49fbf9304a12451402bf92f8996ad2c56f201e6a441c05c52e806832d80e08: Status 404 returned error can't find the container with id 8b49fbf9304a12451402bf92f8996ad2c56f201e6a441c05c52e806832d80e08
Jul 02 19:14:41.099165 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:41.099112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf" event={"ID":"5319a1b8-89ca-4450-bb1b-8813cee83ab8","Type":"ContainerStarted","Data":"8b49fbf9304a12451402bf92f8996ad2c56f201e6a441c05c52e806832d80e08"}
Jul 02 19:14:42.106444 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:42.106402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf" event={"ID":"5319a1b8-89ca-4450-bb1b-8813cee83ab8","Type":"ContainerStarted","Data":"cef57e13e85390ef1eb9d344c62e826bbcca0d58c36b14fdf270ad9a5ebc70ee"}
Jul 02 19:14:42.124369 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:42.124317    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf" podStartSLOduration=2.046966383 podStartE2EDuration="3.124301241s" totalImagesPullingTime="1.077334858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:42.123109047 +0000 UTC m=+808.740835126" watchObservedRunningTime="2026-07-02 19:14:42.124301241 +0000 UTC m=+808.742027318"
Jul 02 19:14:47.310708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.310666    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"]
Jul 02 19:14:47.314386 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.314362    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.319403 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.319380    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 19:14:47.334953 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.334925    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"]
Jul 02 19:14:47.351399 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.351364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.351545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.351412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.351545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.351460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44c09208-c0d2-4a33-b280-9da6f934623f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.351545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.351498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.351545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.351527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzdd\" (UniqueName: \"kubernetes.io/projected/44c09208-c0d2-4a33-b280-9da6f934623f-kube-api-access-bnzdd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.351545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.351545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.452494 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.452460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44c09208-c0d2-4a33-b280-9da6f934623f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.452675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.452516    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.452675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.452559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzdd\" (UniqueName: \"kubernetes.io/projected/44c09208-c0d2-4a33-b280-9da6f934623f-kube-api-access-bnzdd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.452675 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.452654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.452805 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.452717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.452805 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.452778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.453073 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.453048    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.453158 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.453082    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.453213 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.453197    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.454880 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.454864    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44c09208-c0d2-4a33-b280-9da6f934623f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.454928 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.454903    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44c09208-c0d2-4a33-b280-9da6f934623f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.470901 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.470876    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzdd\" (UniqueName: \"kubernetes.io/projected/44c09208-c0d2-4a33-b280-9da6f934623f-kube-api-access-bnzdd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8x27h\" (UID: \"44c09208-c0d2-4a33-b280-9da6f934623f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.624560 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.624461    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:47.759316 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:47.759292    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"]
Jul 02 19:14:47.761472 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:14:47.761442    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c09208_c0d2_4a33_b280_9da6f934623f.slice/crio-40e21a7ad2030e33016b39a554b78f22a78d88de01321888dbcdbaa47c8d4b3e WatchSource:0}: Error finding container 40e21a7ad2030e33016b39a554b78f22a78d88de01321888dbcdbaa47c8d4b3e: Status 404 returned error can't find the container with id 40e21a7ad2030e33016b39a554b78f22a78d88de01321888dbcdbaa47c8d4b3e
Jul 02 19:14:48.134682 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:48.134649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h" event={"ID":"44c09208-c0d2-4a33-b280-9da6f934623f","Type":"ContainerStarted","Data":"35f9fb2a8d61b76ca48bc7dd76d820d710192f8f81c731e07a7c7cc26cfe8484"}
Jul 02 19:14:48.134886 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:48.134703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h" event={"ID":"44c09208-c0d2-4a33-b280-9da6f934623f","Type":"ContainerStarted","Data":"40e21a7ad2030e33016b39a554b78f22a78d88de01321888dbcdbaa47c8d4b3e"}
Jul 02 19:14:48.175599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:48.175541    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h" podStartSLOduration=0.973261232 podStartE2EDuration="1.175524462s" totalImagesPullingTime="202.26323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:48.174054935 +0000 UTC m=+814.791781026" watchObservedRunningTime="2026-07-02 19:14:48.175524462 +0000 UTC m=+814.793250540"
Jul 02 19:14:50.188307 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:50.188260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:50.188695 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:50.188354    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:50.201486 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:50.201459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:51.160966 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:51.160938    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rlsnf"
Jul 02 19:14:57.624593 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:57.624544    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:57.625037 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:57.624649    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:57.637200 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:57.637178    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:14:58.189751 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:14:58.189717    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8x27h"
Jul 02 19:15:11.371109 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.371076    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"]
Jul 02 19:15:11.377762 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.377738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.380806 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.380783    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 19:15:11.385509 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.385486    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"]
Jul 02 19:15:11.473698 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.473661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.473873 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.473736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.473873 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.473764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.473873 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.473782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.473873 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.473806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqj9d\" (UniqueName: \"kubernetes.io/projected/ccc40b07-6c87-4764-8a57-3b9476af8331-kube-api-access-hqj9d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.474042 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.473907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccc40b07-6c87-4764-8a57-3b9476af8331-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.574875 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.574834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.574875 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.574878    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575158 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.574902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575158 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.574936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqj9d\" (UniqueName: \"kubernetes.io/projected/ccc40b07-6c87-4764-8a57-3b9476af8331-kube-api-access-hqj9d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575158 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.574990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccc40b07-6c87-4764-8a57-3b9476af8331-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575158 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.575051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575364 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.575317    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575364 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.575341    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.575471 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.575438    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.577130 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.577103    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccc40b07-6c87-4764-8a57-3b9476af8331-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.577487 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.577468    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccc40b07-6c87-4764-8a57-3b9476af8331-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.583881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.583862    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqj9d\" (UniqueName: \"kubernetes.io/projected/ccc40b07-6c87-4764-8a57-3b9476af8331-kube-api-access-hqj9d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd\" (UID: \"ccc40b07-6c87-4764-8a57-3b9476af8331\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.687784 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.687749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:11.822895 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:11.822866    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"]
Jul 02 19:15:11.824729 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:15:11.824701    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccc40b07_6c87_4764_8a57_3b9476af8331.slice/crio-744b0ed9320d43088fb427f40a36b93d92c9e8f677f63ae8afa4713860012dc6 WatchSource:0}: Error finding container 744b0ed9320d43088fb427f40a36b93d92c9e8f677f63ae8afa4713860012dc6: Status 404 returned error can't find the container with id 744b0ed9320d43088fb427f40a36b93d92c9e8f677f63ae8afa4713860012dc6
Jul 02 19:15:12.243754 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:12.243720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd" event={"ID":"ccc40b07-6c87-4764-8a57-3b9476af8331","Type":"ContainerStarted","Data":"629d49d23b3a98de2fc5050532576f15c883f83ce6ae7d980aa8a2b9a3393716"}
Jul 02 19:15:12.243754 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:12.243760    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd" event={"ID":"ccc40b07-6c87-4764-8a57-3b9476af8331","Type":"ContainerStarted","Data":"744b0ed9320d43088fb427f40a36b93d92c9e8f677f63ae8afa4713860012dc6"}
Jul 02 19:15:12.263175 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:12.263124    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd" podStartSLOduration=1.044192159 podStartE2EDuration="1.263107601s" totalImagesPullingTime="218.915442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:15:12.26134908 +0000 UTC m=+838.879075159" watchObservedRunningTime="2026-07-02 19:15:12.263107601 +0000 UTC m=+838.880833679"
Jul 02 19:15:21.688056 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:21.687987    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:21.688056 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:21.688072    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:21.700461 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:21.700434    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:15:22.301786 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:15:22.301755    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd"
Jul 02 19:16:13.845291 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:13.845209    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:16:13.845862 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:13.845827    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:16:13.850333 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:13.850313    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:16:13.850958 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:13.850936    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:16:31.967560 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:31.967528    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c5ccbc6f4-drmxc"]
Jul 02 19:16:31.970867 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:31.970851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:31.979222 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:31.979201    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c5ccbc6f4-drmxc"]
Jul 02 19:16:32.083250 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.083220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d8gh\" (UniqueName: \"kubernetes.io/projected/59345305-393c-4c0e-9769-aa866e7cd948-kube-api-access-2d8gh\") pod \"authorino-7c5ccbc6f4-drmxc\" (UID: \"59345305-393c-4c0e-9769-aa866e7cd948\") " pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.083408 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.083266    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59345305-393c-4c0e-9769-aa866e7cd948-tls-cert\") pod \"authorino-7c5ccbc6f4-drmxc\" (UID: \"59345305-393c-4c0e-9769-aa866e7cd948\") " pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.184604 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.184573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d8gh\" (UniqueName: \"kubernetes.io/projected/59345305-393c-4c0e-9769-aa866e7cd948-kube-api-access-2d8gh\") pod \"authorino-7c5ccbc6f4-drmxc\" (UID: \"59345305-393c-4c0e-9769-aa866e7cd948\") " pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.184770 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.184629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59345305-393c-4c0e-9769-aa866e7cd948-tls-cert\") pod \"authorino-7c5ccbc6f4-drmxc\" (UID: \"59345305-393c-4c0e-9769-aa866e7cd948\") " pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.187214 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.187190    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59345305-393c-4c0e-9769-aa866e7cd948-tls-cert\") pod \"authorino-7c5ccbc6f4-drmxc\" (UID: \"59345305-393c-4c0e-9769-aa866e7cd948\") " pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.192649 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.192627    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d8gh\" (UniqueName: \"kubernetes.io/projected/59345305-393c-4c0e-9769-aa866e7cd948-kube-api-access-2d8gh\") pod \"authorino-7c5ccbc6f4-drmxc\" (UID: \"59345305-393c-4c0e-9769-aa866e7cd948\") " pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.280584 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.280499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc"
Jul 02 19:16:32.420494 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.420473    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c5ccbc6f4-drmxc"]
Jul 02 19:16:32.422612 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:16:32.422583    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59345305_393c_4c0e_9769_aa866e7cd948.slice/crio-dfa68371c52f4e733eb16b5511e2d549077dd8cba5dcda6707e2dd21081e843c WatchSource:0}: Error finding container dfa68371c52f4e733eb16b5511e2d549077dd8cba5dcda6707e2dd21081e843c: Status 404 returned error can't find the container with id dfa68371c52f4e733eb16b5511e2d549077dd8cba5dcda6707e2dd21081e843c
Jul 02 19:16:32.608148 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:32.608052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc" event={"ID":"59345305-393c-4c0e-9769-aa866e7cd948","Type":"ContainerStarted","Data":"dfa68371c52f4e733eb16b5511e2d549077dd8cba5dcda6707e2dd21081e843c"}
Jul 02 19:16:33.615535 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:33.615490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc" event={"ID":"59345305-393c-4c0e-9769-aa866e7cd948","Type":"ContainerStarted","Data":"3894ef85b507b28aaea5ebd41e7114969d7a2dc1c9368946240324bc049c9e5f"}
Jul 02 19:16:33.648642 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:33.648576    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c5ccbc6f4-drmxc" podStartSLOduration=2.172441051 podStartE2EDuration="2.648540899s" totalImagesPullingTime="476.099848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:33.647581976 +0000 UTC m=+920.265308056" watchObservedRunningTime="2026-07-02 19:16:33.648540899 +0000 UTC m=+920.266266978"
Jul 02 19:16:33.693180 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:33.693136    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68ccb57955-2d6tk"]
Jul 02 19:16:33.693617 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:33.693581    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-68ccb57955-2d6tk" podUID="f802d39a-a8e9-4af2-b93c-e5861a4ba24d" containerName="authorino" containerID="cri-o://2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7" gracePeriod=30
Jul 02 19:16:33.962926 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:33.962899    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:16:34.002962 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.002927    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kqwl\" (UniqueName: \"kubernetes.io/projected/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-kube-api-access-8kqwl\") pod \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") "
Jul 02 19:16:34.003170 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.003119    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-tls-cert\") pod \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\" (UID: \"f802d39a-a8e9-4af2-b93c-e5861a4ba24d\") "
Jul 02 19:16:34.005552 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.005516    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-kube-api-access-8kqwl" (OuterVolumeSpecName: "kube-api-access-8kqwl") pod "f802d39a-a8e9-4af2-b93c-e5861a4ba24d" (UID: "f802d39a-a8e9-4af2-b93c-e5861a4ba24d"). InnerVolumeSpecName "kube-api-access-8kqwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:16:34.014642 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.014614    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f802d39a-a8e9-4af2-b93c-e5861a4ba24d" (UID: "f802d39a-a8e9-4af2-b93c-e5861a4ba24d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:16:34.104000 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.103959    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-tls-cert\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:16:34.104000 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.103990    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kqwl\" (UniqueName: \"kubernetes.io/projected/f802d39a-a8e9-4af2-b93c-e5861a4ba24d-kube-api-access-8kqwl\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:16:34.621362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.621278    2567 generic.go:356] "Generic (PLEG): container finished" podID="f802d39a-a8e9-4af2-b93c-e5861a4ba24d" containerID="2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7" exitCode=0
Jul 02 19:16:34.621362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.621324    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ccb57955-2d6tk"
Jul 02 19:16:34.621362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.621358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ccb57955-2d6tk" event={"ID":"f802d39a-a8e9-4af2-b93c-e5861a4ba24d","Type":"ContainerDied","Data":"2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7"}
Jul 02 19:16:34.621857 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.621390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ccb57955-2d6tk" event={"ID":"f802d39a-a8e9-4af2-b93c-e5861a4ba24d","Type":"ContainerDied","Data":"be3fdccf869c67919408f9ba85ce7b25829d142afb232881c28361977a0fb5c0"}
Jul 02 19:16:34.621857 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.621407    2567 scope.go:117] "RemoveContainer" containerID="2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7"
Jul 02 19:16:34.633139 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.633110    2567 scope.go:117] "RemoveContainer" containerID="2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7"
Jul 02 19:16:34.633418 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:16:34.633393    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7\": container with ID starting with 2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7 not found: ID does not exist" containerID="2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7"
Jul 02 19:16:34.633497 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.633430    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7"} err="failed to get container status \"2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7\": rpc error: code = NotFound desc = could not find container \"2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7\": container with ID starting with 2e2b71728dd19902b1c4a19fec6039b73328658b5a63a3bc93bf0bd0950d55d7 not found: ID does not exist"
Jul 02 19:16:34.654942 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.654915    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68ccb57955-2d6tk"]
Jul 02 19:16:34.661646 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:34.661624    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68ccb57955-2d6tk"]
Jul 02 19:16:35.940482 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:16:35.940449    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f802d39a-a8e9-4af2-b93c-e5861a4ba24d" path="/var/lib/kubelet/pods/f802d39a-a8e9-4af2-b93c-e5861a4ba24d/volumes"
Jul 02 19:21:13.872068 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:21:13.871975    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:21:13.874447 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:21:13.874417    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:21:13.876416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:21:13.876400    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:21:13.878456 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:21:13.878440    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:22:32.086092 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:32.086051    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"]
Jul 02 19:22:32.088826 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:32.086329    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td" podUID="79940e9d-769f-4c63-bfd3-aee2162cc660" containerName="manager" containerID="cri-o://a63bff86ecab0270ad882772378bcc86439b4e17675b940e521114a0b20e3794" gracePeriod=10
Jul 02 19:22:34.278698 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.278660    2567 generic.go:356] "Generic (PLEG): container finished" podID="79940e9d-769f-4c63-bfd3-aee2162cc660" containerID="a63bff86ecab0270ad882772378bcc86439b4e17675b940e521114a0b20e3794" exitCode=0
Jul 02 19:22:34.279041 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.278714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td" event={"ID":"79940e9d-769f-4c63-bfd3-aee2162cc660","Type":"ContainerDied","Data":"a63bff86ecab0270ad882772378bcc86439b4e17675b940e521114a0b20e3794"}
Jul 02 19:22:34.331413 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.331389    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:22:34.414191 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.414102    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjp65\" (UniqueName: \"kubernetes.io/projected/79940e9d-769f-4c63-bfd3-aee2162cc660-kube-api-access-jjp65\") pod \"79940e9d-769f-4c63-bfd3-aee2162cc660\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") "
Jul 02 19:22:34.414191 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.414153    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79940e9d-769f-4c63-bfd3-aee2162cc660-extensions-socket-volume\") pod \"79940e9d-769f-4c63-bfd3-aee2162cc660\" (UID: \"79940e9d-769f-4c63-bfd3-aee2162cc660\") "
Jul 02 19:22:34.414558 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.414536    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79940e9d-769f-4c63-bfd3-aee2162cc660-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79940e9d-769f-4c63-bfd3-aee2162cc660" (UID: "79940e9d-769f-4c63-bfd3-aee2162cc660"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:22:34.416088 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.416067    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79940e9d-769f-4c63-bfd3-aee2162cc660-kube-api-access-jjp65" (OuterVolumeSpecName: "kube-api-access-jjp65") pod "79940e9d-769f-4c63-bfd3-aee2162cc660" (UID: "79940e9d-769f-4c63-bfd3-aee2162cc660"). InnerVolumeSpecName "kube-api-access-jjp65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:22:34.515685 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.515655    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjp65\" (UniqueName: \"kubernetes.io/projected/79940e9d-769f-4c63-bfd3-aee2162cc660-kube-api-access-jjp65\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:22:34.515685 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:34.515680    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79940e9d-769f-4c63-bfd3-aee2162cc660-extensions-socket-volume\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:22:35.284704 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:35.284674    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"
Jul 02 19:22:35.285185 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:35.284699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td" event={"ID":"79940e9d-769f-4c63-bfd3-aee2162cc660","Type":"ContainerDied","Data":"1a719ba0e82f39973d299906c34f60b4290a99fdb87e7e574310cc81d716f7e3"}
Jul 02 19:22:35.285185 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:35.284760    2567 scope.go:117] "RemoveContainer" containerID="a63bff86ecab0270ad882772378bcc86439b4e17675b940e521114a0b20e3794"
Jul 02 19:22:35.307414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:35.307382    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"]
Jul 02 19:22:35.311434 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:35.311411    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pb4td"]
Jul 02 19:22:35.939915 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:22:35.939884    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79940e9d-769f-4c63-bfd3-aee2162cc660" path="/var/lib/kubelet/pods/79940e9d-769f-4c63-bfd3-aee2162cc660/volumes"
Jul 02 19:23:33.282814 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.282785    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"]
Jul 02 19:23:33.283292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.283136    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f802d39a-a8e9-4af2-b93c-e5861a4ba24d" containerName="authorino"
Jul 02 19:23:33.283292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.283148    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f802d39a-a8e9-4af2-b93c-e5861a4ba24d" containerName="authorino"
Jul 02 19:23:33.283292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.283163    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79940e9d-769f-4c63-bfd3-aee2162cc660" containerName="manager"
Jul 02 19:23:33.283292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.283171    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79940e9d-769f-4c63-bfd3-aee2162cc660" containerName="manager"
Jul 02 19:23:33.283292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.283240    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f802d39a-a8e9-4af2-b93c-e5861a4ba24d" containerName="authorino"
Jul 02 19:23:33.283292 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.283248    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="79940e9d-769f-4c63-bfd3-aee2162cc660" containerName="manager"
Jul 02 19:23:33.287486 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.287469    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.290881 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.290863    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68jph\""
Jul 02 19:23:33.300422 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.300399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"]
Jul 02 19:23:33.338203 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.338173    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk6z4\" (UniqueName: \"kubernetes.io/projected/9c4fad7b-4244-49a8-b458-11ffbed637f3-kube-api-access-xk6z4\") pod \"kuadrant-operator-controller-manager-86878c769f-4jf9b\" (UID: \"9c4fad7b-4244-49a8-b458-11ffbed637f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.338368 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.338294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4fad7b-4244-49a8-b458-11ffbed637f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jf9b\" (UID: \"9c4fad7b-4244-49a8-b458-11ffbed637f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.438931 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.438894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4fad7b-4244-49a8-b458-11ffbed637f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jf9b\" (UID: \"9c4fad7b-4244-49a8-b458-11ffbed637f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.439102 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.438953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk6z4\" (UniqueName: \"kubernetes.io/projected/9c4fad7b-4244-49a8-b458-11ffbed637f3-kube-api-access-xk6z4\") pod \"kuadrant-operator-controller-manager-86878c769f-4jf9b\" (UID: \"9c4fad7b-4244-49a8-b458-11ffbed637f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.439308 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.439288    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4fad7b-4244-49a8-b458-11ffbed637f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4jf9b\" (UID: \"9c4fad7b-4244-49a8-b458-11ffbed637f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.449135 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.449109    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk6z4\" (UniqueName: \"kubernetes.io/projected/9c4fad7b-4244-49a8-b458-11ffbed637f3-kube-api-access-xk6z4\") pod \"kuadrant-operator-controller-manager-86878c769f-4jf9b\" (UID: \"9c4fad7b-4244-49a8-b458-11ffbed637f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.597565 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.597486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:33.735007 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:33.734983    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"]
Jul 02 19:23:33.736656 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:23:33.736629    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4fad7b_4244_49a8_b458_11ffbed637f3.slice/crio-bd2ef468798b29b324e6fea1d8d41253ee53746536d45690f4de6f3b92c3848c WatchSource:0}: Error finding container bd2ef468798b29b324e6fea1d8d41253ee53746536d45690f4de6f3b92c3848c: Status 404 returned error can't find the container with id bd2ef468798b29b324e6fea1d8d41253ee53746536d45690f4de6f3b92c3848c
Jul 02 19:23:34.551218 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:34.551180    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b" event={"ID":"9c4fad7b-4244-49a8-b458-11ffbed637f3","Type":"ContainerStarted","Data":"3fd3981c1abbeb47fee2d15bcf4c02c27a93a97e949be697ea2e6e84e0da03e9"}
Jul 02 19:23:34.551606 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:34.551243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b" event={"ID":"9c4fad7b-4244-49a8-b458-11ffbed637f3","Type":"ContainerStarted","Data":"bd2ef468798b29b324e6fea1d8d41253ee53746536d45690f4de6f3b92c3848c"}
Jul 02 19:23:34.551606 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:34.551311    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:23:34.577493 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:34.577441    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b" podStartSLOduration=1.5774256420000001 podStartE2EDuration="1.577425642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:23:34.574423929 +0000 UTC m=+1341.192150021" watchObservedRunningTime="2026-07-02 19:23:34.577425642 +0000 UTC m=+1341.195151719"
Jul 02 19:23:45.557988 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:23:45.557958    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4jf9b"
Jul 02 19:26:13.902207 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:26:13.902175    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:26:13.904441 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:26:13.904415    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:26:13.906484 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:26:13.906462    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:26:13.908653 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:26:13.908636    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:31:13.930116 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:31:13.930087    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:31:13.932049 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:31:13.932026    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:31:13.934969 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:31:13.934944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:31:13.936825 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:31:13.936805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:33:15.091146 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.091114    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"]
Jul 02 19:33:15.094611 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.094587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.097923 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.097898    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-dbb83b48\"/\"e2e-lifecycle-model-dbb83b48-kserve-self-signed-certs\""
Jul 02 19:33:15.098973 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.098950    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-dbb83b48\"/\"default-dockercfg-ggzwv\""
Jul 02 19:33:15.099101 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.098997    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-dbb83b48\"/\"kube-root-ca.crt\""
Jul 02 19:33:15.099101 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.099005    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-dbb83b48\"/\"openshift-service-ca.crt\""
Jul 02 19:33:15.107319 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.107294    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"]
Jul 02 19:33:15.239087 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.239048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tls-certs\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.239283 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.239100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkrwz\" (UniqueName: \"kubernetes.io/projected/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-kube-api-access-dkrwz\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.239283 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.239199    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-home\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.239283 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.239260    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-model-cache\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.239449 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.239381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-dshm\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.239548 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.239447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tmp-dir\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340389 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkrwz\" (UniqueName: \"kubernetes.io/projected/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-kube-api-access-dkrwz\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340563 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-home\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340563 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-model-cache\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340697 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-dshm\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340763 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-home\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340763 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tmp-dir\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340870 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340759    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tls-certs\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340870 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340822    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-model-cache\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.340998 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.340982    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tmp-dir\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.342958 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.342895    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-dshm\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.343253 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.343237    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tls-certs\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.348506 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.348473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkrwz\" (UniqueName: \"kubernetes.io/projected/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-kube-api-access-dkrwz\") pod \"e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") " pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.405332 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.405301    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:15.534575 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:15.534546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"]
Jul 02 19:33:15.536007 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:33:15.535980    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5f8c4d0_812d_44fa_aac7_f1bc60b9aa4b.slice/crio-69c3b83108a8e42423b0e09dcc30d85ae1fdac08bfbe4c14d87ac04474498541 WatchSource:0}: Error finding container 69c3b83108a8e42423b0e09dcc30d85ae1fdac08bfbe4c14d87ac04474498541: Status 404 returned error can't find the container with id 69c3b83108a8e42423b0e09dcc30d85ae1fdac08bfbe4c14d87ac04474498541
Jul 02 19:33:16.204396 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:16.204361    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52" event={"ID":"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b","Type":"ContainerStarted","Data":"606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128"}
Jul 02 19:33:16.204396 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:16.204402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52" event={"ID":"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b","Type":"ContainerStarted","Data":"69c3b83108a8e42423b0e09dcc30d85ae1fdac08bfbe4c14d87ac04474498541"}
Jul 02 19:33:16.221089 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:16.221040    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52" podStartSLOduration=1.221025601 podStartE2EDuration="1.221025601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:16.220086324 +0000 UTC m=+1922.837812402" watchObservedRunningTime="2026-07-02 19:33:16.221025601 +0000 UTC m=+1922.838751669"
Jul 02 19:33:25.406439 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:25.406407    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:25.406848 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:25.406690    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:25.418828 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:25.418806    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:26.259617 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:26.259589    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:33:48.420408 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:33:48.420372    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"]
Jul 02 19:34:03.441664 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.441604    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52" podUID="a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" containerName="main" containerID="cri-o://606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128" gracePeriod=45
Jul 02 19:34:03.685949 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.685926    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:34:03.690068 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690050    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tls-certs\") pod \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") "
Jul 02 19:34:03.690153 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690090    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-model-cache\") pod \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") "
Jul 02 19:34:03.690153 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690114    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-home\") pod \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") "
Jul 02 19:34:03.690221 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690155    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkrwz\" (UniqueName: \"kubernetes.io/projected/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-kube-api-access-dkrwz\") pod \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") "
Jul 02 19:34:03.690221 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690179    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-dshm\") pod \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") "
Jul 02 19:34:03.690221 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690212    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tmp-dir\") pod \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\" (UID: \"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b\") "
Jul 02 19:34:03.690378 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690351    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" (UID: "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:03.690438 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690400    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-home" (OuterVolumeSpecName: "home") pod "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" (UID: "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:03.690521 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690493    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" (UID: "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:03.690572 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690520    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-model-cache\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:34:03.690572 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.690536    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-home\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:34:03.692262 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.692210    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" (UID: "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:34:03.692353 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.692251    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-dshm" (OuterVolumeSpecName: "dshm") pod "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" (UID: "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:34:03.692353 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.692262    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-kube-api-access-dkrwz" (OuterVolumeSpecName: "kube-api-access-dkrwz") pod "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" (UID: "a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b"). InnerVolumeSpecName "kube-api-access-dkrwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:34:03.790990 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.790955    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkrwz\" (UniqueName: \"kubernetes.io/projected/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-kube-api-access-dkrwz\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:34:03.790990 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.790986    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-dshm\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:34:03.790990 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.790997    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tmp-dir\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:34:03.791227 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:03.791005    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b-tls-certs\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:34:04.425235 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.425199    2567 generic.go:356] "Generic (PLEG): container finished" podID="a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" containerID="606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128" exitCode=0
Jul 02 19:34:04.425416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.425241    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"
Jul 02 19:34:04.425416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.425285    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52" event={"ID":"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b","Type":"ContainerDied","Data":"606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128"}
Jul 02 19:34:04.425416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.425335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52" event={"ID":"a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b","Type":"ContainerDied","Data":"69c3b83108a8e42423b0e09dcc30d85ae1fdac08bfbe4c14d87ac04474498541"}
Jul 02 19:34:04.425416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.425357    2567 scope.go:117] "RemoveContainer" containerID="606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128"
Jul 02 19:34:04.433900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.433881    2567 scope.go:117] "RemoveContainer" containerID="606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128"
Jul 02 19:34:04.434161 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:34:04.434141    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128\": container with ID starting with 606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128 not found: ID does not exist" containerID="606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128"
Jul 02 19:34:04.434245 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.434172    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128"} err="failed to get container status \"606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128\": rpc error: code = NotFound desc = could not find container \"606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128\": container with ID starting with 606cab355450533fe79a750d57115c6946db5ca080a0bfe1a9f60012ded29128 not found: ID does not exist"
Jul 02 19:34:04.442052 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.442029    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"]
Jul 02 19:34:04.446473 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:04.446455    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-dbb83b48/e2e-lifecycle-model-dbb83b48-kserve-7bb4568fb7-twf52"]
Jul 02 19:34:05.940840 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:34:05.940810    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" path="/var/lib/kubelet/pods/a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b/volumes"
Jul 02 19:36:13.961138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:13.961108    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:36:13.964142 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:13.964118    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:36:13.965606 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:13.965584    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:36:13.968595 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:13.968576    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:36:22.092035 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.091984    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"]
Jul 02 19:36:22.092402 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.092352    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" containerName="main"
Jul 02 19:36:22.092402 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.092364    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" containerName="main"
Jul 02 19:36:22.092471 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.092430    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f8c4d0-812d-44fa-aac7-f1bc60b9aa4b" containerName="main"
Jul 02 19:36:22.095311 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.095291    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.102379 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.102357    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4fd26d\"/\"kube-root-ca.crt\""
Jul 02 19:36:22.103541 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.103519    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4fd26d\"/\"default-dockercfg-nm444\""
Jul 02 19:36:22.103634 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.103541    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4fd26d\"/\"openshift-service-ca.crt\""
Jul 02 19:36:22.103634 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.103519    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4fd26d\"/\"test-model-4fd26d-kserve-self-signed-certs\""
Jul 02 19:36:22.111895 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.111873    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"]
Jul 02 19:36:22.135769 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.135745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tmp-dir\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.135900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.135800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8k6\" (UniqueName: \"kubernetes.io/projected/5fe949a0-f477-4da4-89c2-c3ba8d135b24-kube-api-access-bl8k6\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.135900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.135824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-home\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.135900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.135856    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tls-certs\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.135900 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.135880    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-dshm\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.136050 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.135908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-model-cache\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237205 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tls-certs\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237205 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-dshm\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237435 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-model-cache\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237435 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tmp-dir\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237515 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237467    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8k6\" (UniqueName: \"kubernetes.io/projected/5fe949a0-f477-4da4-89c2-c3ba8d135b24-kube-api-access-bl8k6\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237515 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-home\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237601 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237575    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-model-cache\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237907 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237879    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-home\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.237907 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.237906    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tmp-dir\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.240106 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.240078    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-dshm\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.240270 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.240253    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tls-certs\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.247004 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.246974    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8k6\" (UniqueName: \"kubernetes.io/projected/5fe949a0-f477-4da4-89c2-c3ba8d135b24-kube-api-access-bl8k6\") pod \"test-model-4fd26d-kserve-77994884d9-xdsmz\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") " pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.404270 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.404228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:22.537960 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:22.537931    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"]
Jul 02 19:36:22.540503 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:36:22.540466    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fe949a0_f477_4da4_89c2_c3ba8d135b24.slice/crio-129587e0bd521546c7ef2f9dc7d167e401cbefc313e0d3e83fc89ac99f1ab1fa WatchSource:0}: Error finding container 129587e0bd521546c7ef2f9dc7d167e401cbefc313e0d3e83fc89ac99f1ab1fa: Status 404 returned error can't find the container with id 129587e0bd521546c7ef2f9dc7d167e401cbefc313e0d3e83fc89ac99f1ab1fa
Jul 02 19:36:23.067583 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:23.067547    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz" event={"ID":"5fe949a0-f477-4da4-89c2-c3ba8d135b24","Type":"ContainerStarted","Data":"6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559"}
Jul 02 19:36:23.067583 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:23.067586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz" event={"ID":"5fe949a0-f477-4da4-89c2-c3ba8d135b24","Type":"ContainerStarted","Data":"129587e0bd521546c7ef2f9dc7d167e401cbefc313e0d3e83fc89ac99f1ab1fa"}
Jul 02 19:36:32.404848 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:32.404793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:32.405637 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:32.404867    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:32.417898 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:32.417872    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:32.435771 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:32.435706    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz" podStartSLOduration=10.435686273 podStartE2EDuration="10.435686273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:36:23.093332572 +0000 UTC m=+2109.711058651" watchObservedRunningTime="2026-07-02 19:36:32.435686273 +0000 UTC m=+2119.053412354"
Jul 02 19:36:33.126205 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:33.126177    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:43.468490 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:43.468460    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"]
Jul 02 19:36:58.489057 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.488971    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz" podUID="5fe949a0-f477-4da4-89c2-c3ba8d135b24" containerName="main" containerID="cri-o://6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559" gracePeriod=45
Jul 02 19:36:58.737307 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.737284    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:58.773227 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773166    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tmp-dir\") pod \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") "
Jul 02 19:36:58.773227 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773198    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-dshm\") pod \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") "
Jul 02 19:36:58.773227 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773223    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-model-cache\") pod \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") "
Jul 02 19:36:58.773476 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773285    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-home\") pod \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") "
Jul 02 19:36:58.773476 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773328    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl8k6\" (UniqueName: \"kubernetes.io/projected/5fe949a0-f477-4da4-89c2-c3ba8d135b24-kube-api-access-bl8k6\") pod \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") "
Jul 02 19:36:58.773476 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773360    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tls-certs\") pod \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\" (UID: \"5fe949a0-f477-4da4-89c2-c3ba8d135b24\") "
Jul 02 19:36:58.773634 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773528    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-model-cache" (OuterVolumeSpecName: "model-cache") pod "5fe949a0-f477-4da4-89c2-c3ba8d135b24" (UID: "5fe949a0-f477-4da4-89c2-c3ba8d135b24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:58.773634 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773562    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-home" (OuterVolumeSpecName: "home") pod "5fe949a0-f477-4da4-89c2-c3ba8d135b24" (UID: "5fe949a0-f477-4da4-89c2-c3ba8d135b24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:58.773753 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773733    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-home\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:36:58.773803 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773755    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-model-cache\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:36:58.773864 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.773488    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5fe949a0-f477-4da4-89c2-c3ba8d135b24" (UID: "5fe949a0-f477-4da4-89c2-c3ba8d135b24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:58.775488 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.775462    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-dshm" (OuterVolumeSpecName: "dshm") pod "5fe949a0-f477-4da4-89c2-c3ba8d135b24" (UID: "5fe949a0-f477-4da4-89c2-c3ba8d135b24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:58.775619 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.775518    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe949a0-f477-4da4-89c2-c3ba8d135b24-kube-api-access-bl8k6" (OuterVolumeSpecName: "kube-api-access-bl8k6") pod "5fe949a0-f477-4da4-89c2-c3ba8d135b24" (UID: "5fe949a0-f477-4da4-89c2-c3ba8d135b24"). InnerVolumeSpecName "kube-api-access-bl8k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:58.775664 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.775631    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5fe949a0-f477-4da4-89c2-c3ba8d135b24" (UID: "5fe949a0-f477-4da4-89c2-c3ba8d135b24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:36:58.874463 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.874435    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl8k6\" (UniqueName: \"kubernetes.io/projected/5fe949a0-f477-4da4-89c2-c3ba8d135b24-kube-api-access-bl8k6\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:36:58.874463 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.874459    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tls-certs\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:36:58.874463 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.874469    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-tmp-dir\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:36:58.874685 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:58.874478    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe949a0-f477-4da4-89c2-c3ba8d135b24-dshm\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:36:59.237506 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.237471    2567 generic.go:356] "Generic (PLEG): container finished" podID="5fe949a0-f477-4da4-89c2-c3ba8d135b24" containerID="6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559" exitCode=0
Jul 02 19:36:59.237506 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.237508    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"
Jul 02 19:36:59.237746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.237560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz" event={"ID":"5fe949a0-f477-4da4-89c2-c3ba8d135b24","Type":"ContainerDied","Data":"6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559"}
Jul 02 19:36:59.237746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.237611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz" event={"ID":"5fe949a0-f477-4da4-89c2-c3ba8d135b24","Type":"ContainerDied","Data":"129587e0bd521546c7ef2f9dc7d167e401cbefc313e0d3e83fc89ac99f1ab1fa"}
Jul 02 19:36:59.237746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.237640    2567 scope.go:117] "RemoveContainer" containerID="6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559"
Jul 02 19:36:59.248458 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.248441    2567 scope.go:117] "RemoveContainer" containerID="6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559"
Jul 02 19:36:59.248722 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:36:59.248702    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559\": container with ID starting with 6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559 not found: ID does not exist" containerID="6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559"
Jul 02 19:36:59.248797 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.248730    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559"} err="failed to get container status \"6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559\": rpc error: code = NotFound desc = could not find container \"6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559\": container with ID starting with 6b6c7a7c6720545bdd13b2906d158de3f0d44b0d096ed3fb70a924acfd6f7559 not found: ID does not exist"
Jul 02 19:36:59.256372 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:36:59.256349    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fe949a0_f477_4da4_89c2_c3ba8d135b24.slice\": RecentStats: unable to find data in memory cache]"
Jul 02 19:36:59.280942 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.280917    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"]
Jul 02 19:36:59.289475 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.289453    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4fd26d/test-model-4fd26d-kserve-77994884d9-xdsmz"]
Jul 02 19:36:59.940092 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:36:59.940053    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe949a0-f477-4da4-89c2-c3ba8d135b24" path="/var/lib/kubelet/pods/5fe949a0-f477-4da4-89c2-c3ba8d135b24/volumes"
Jul 02 19:39:08.383117 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.383085    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"]
Jul 02 19:39:08.383527 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.383407    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe949a0-f477-4da4-89c2-c3ba8d135b24" containerName="main"
Jul 02 19:39:08.383527 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.383417    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe949a0-f477-4da4-89c2-c3ba8d135b24" containerName="main"
Jul 02 19:39:08.383527 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.383489    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe949a0-f477-4da4-89c2-c3ba8d135b24" containerName="main"
Jul 02 19:39:08.391846 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.391828    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.395407 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.395378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"]
Jul 02 19:39:08.395939 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.395860    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"kube-root-ca.crt\""
Jul 02 19:39:08.395939 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.395903    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"default-dockercfg-g8872\""
Jul 02 19:39:08.395939 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.395920    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"auth-test-model-6e39fb-kserve-self-signed-certs\""
Jul 02 19:39:08.396198 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.395903    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"openshift-service-ca.crt\""
Jul 02 19:39:08.537387 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.537346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-home\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.537387 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.537393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-model-cache\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.537699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.537414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d65916e-7863-48bb-9132-7b8073ef8b79-tls-certs\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.537699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.537484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-tmp-dir\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.537699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.537540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fmss\" (UniqueName: \"kubernetes.io/projected/5d65916e-7863-48bb-9132-7b8073ef8b79-kube-api-access-9fmss\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.537699 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.537576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-dshm\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638212 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-dshm\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638212 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-home\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638212 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-model-cache\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638212 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638207    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d65916e-7863-48bb-9132-7b8073ef8b79-tls-certs\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-tmp-dir\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638545 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638273    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fmss\" (UniqueName: \"kubernetes.io/projected/5d65916e-7863-48bb-9132-7b8073ef8b79-kube-api-access-9fmss\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638688 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638655    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-model-cache\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638748 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638700    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-home\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.638748 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.638665    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-tmp-dir\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.641078 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.641043    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-dshm\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.641223 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.641204    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d65916e-7863-48bb-9132-7b8073ef8b79-tls-certs\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.648935 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.648913    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fmss\" (UniqueName: \"kubernetes.io/projected/5d65916e-7863-48bb-9132-7b8073ef8b79-kube-api-access-9fmss\") pod \"auth-test-model-6e39fb-kserve-674ccd7-d7hmf\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") " pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.702265 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.702240    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:08.836895 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:08.836857    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"]
Jul 02 19:39:08.843605 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:39:08.843573    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d65916e_7863_48bb_9132_7b8073ef8b79.slice/crio-a0a28f4cc2cf350d0539cbb956e55c404d22f315c4603af3258878084d958f12 WatchSource:0}: Error finding container a0a28f4cc2cf350d0539cbb956e55c404d22f315c4603af3258878084d958f12: Status 404 returned error can't find the container with id a0a28f4cc2cf350d0539cbb956e55c404d22f315c4603af3258878084d958f12
Jul 02 19:39:09.840741 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:09.840703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf" event={"ID":"5d65916e-7863-48bb-9132-7b8073ef8b79","Type":"ContainerStarted","Data":"808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549"}
Jul 02 19:39:09.841145 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:09.840754    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf" event={"ID":"5d65916e-7863-48bb-9132-7b8073ef8b79","Type":"ContainerStarted","Data":"a0a28f4cc2cf350d0539cbb956e55c404d22f315c4603af3258878084d958f12"}
Jul 02 19:39:09.880236 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:09.880186    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf" podStartSLOduration=1.88017221 podStartE2EDuration="1.88017221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:09.875312376 +0000 UTC m=+2276.493038491" watchObservedRunningTime="2026-07-02 19:39:09.88017221 +0000 UTC m=+2276.497898287"
Jul 02 19:39:18.703245 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:18.703206    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:18.703754 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:18.703261    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:18.715950 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:18.715924    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:39:18.893542 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:39:18.893510    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:41:08.050663 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:08.049639    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"]
Jul 02 19:41:13.988930 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:13.988902    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:41:13.992442 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:13.992419    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:41:13.993461 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:13.993444    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:41:13.999702 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:13.999681    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxj45_4d15f856-94f2-43db-9420-ce3ac03272e7/ovn-acl-logging/0.log"
Jul 02 19:41:23.074238 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.074180    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf" podUID="5d65916e-7863-48bb-9132-7b8073ef8b79" containerName="main" containerID="cri-o://808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549" gracePeriod=45
Jul 02 19:41:23.322045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.321999    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:41:23.449677 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449647    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-model-cache\") pod \"5d65916e-7863-48bb-9132-7b8073ef8b79\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") "
Jul 02 19:41:23.449852 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449695    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fmss\" (UniqueName: \"kubernetes.io/projected/5d65916e-7863-48bb-9132-7b8073ef8b79-kube-api-access-9fmss\") pod \"5d65916e-7863-48bb-9132-7b8073ef8b79\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") "
Jul 02 19:41:23.449852 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449755    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-tmp-dir\") pod \"5d65916e-7863-48bb-9132-7b8073ef8b79\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") "
Jul 02 19:41:23.449852 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449815    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-home\") pod \"5d65916e-7863-48bb-9132-7b8073ef8b79\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") "
Jul 02 19:41:23.450045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449915    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d65916e-7863-48bb-9132-7b8073ef8b79" (UID: "5d65916e-7863-48bb-9132-7b8073ef8b79"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:23.450045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449925    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d65916e-7863-48bb-9132-7b8073ef8b79-tls-certs\") pod \"5d65916e-7863-48bb-9132-7b8073ef8b79\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") "
Jul 02 19:41:23.450045 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.449986    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-dshm\") pod \"5d65916e-7863-48bb-9132-7b8073ef8b79\" (UID: \"5d65916e-7863-48bb-9132-7b8073ef8b79\") "
Jul 02 19:41:23.450200 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.450046    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d65916e-7863-48bb-9132-7b8073ef8b79" (UID: "5d65916e-7863-48bb-9132-7b8073ef8b79"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:23.450200 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.450089    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-home" (OuterVolumeSpecName: "home") pod "5d65916e-7863-48bb-9132-7b8073ef8b79" (UID: "5d65916e-7863-48bb-9132-7b8073ef8b79"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:23.450372 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.450355    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-tmp-dir\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.450431 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.450378    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-home\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.450431 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.450391    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-model-cache\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.452271 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.452244    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d65916e-7863-48bb-9132-7b8073ef8b79-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d65916e-7863-48bb-9132-7b8073ef8b79" (UID: "5d65916e-7863-48bb-9132-7b8073ef8b79"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:41:23.452407 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.452284    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d65916e-7863-48bb-9132-7b8073ef8b79-kube-api-access-9fmss" (OuterVolumeSpecName: "kube-api-access-9fmss") pod "5d65916e-7863-48bb-9132-7b8073ef8b79" (UID: "5d65916e-7863-48bb-9132-7b8073ef8b79"). InnerVolumeSpecName "kube-api-access-9fmss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:41:23.452478 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.452422    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-dshm" (OuterVolumeSpecName: "dshm") pod "5d65916e-7863-48bb-9132-7b8073ef8b79" (UID: "5d65916e-7863-48bb-9132-7b8073ef8b79"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:23.455365 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.455341    2567 generic.go:356] "Generic (PLEG): container finished" podID="5d65916e-7863-48bb-9132-7b8073ef8b79" containerID="808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549" exitCode=0
Jul 02 19:41:23.455465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.455385    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"
Jul 02 19:41:23.455465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.455401    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf" event={"ID":"5d65916e-7863-48bb-9132-7b8073ef8b79","Type":"ContainerDied","Data":"808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549"}
Jul 02 19:41:23.455465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.455433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf" event={"ID":"5d65916e-7863-48bb-9132-7b8073ef8b79","Type":"ContainerDied","Data":"a0a28f4cc2cf350d0539cbb956e55c404d22f315c4603af3258878084d958f12"}
Jul 02 19:41:23.455465 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.455449    2567 scope.go:117] "RemoveContainer" containerID="808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549"
Jul 02 19:41:23.474200 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.471727    2567 scope.go:117] "RemoveContainer" containerID="808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549"
Jul 02 19:41:23.474200 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:41:23.472825    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549\": container with ID starting with 808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549 not found: ID does not exist" containerID="808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549"
Jul 02 19:41:23.474200 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.472863    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549"} err="failed to get container status \"808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549\": rpc error: code = NotFound desc = could not find container \"808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549\": container with ID starting with 808fbdec6320599ceaff1e6939ffb3f08c44e461f605c82afa31aabd26772549 not found: ID does not exist"
Jul 02 19:41:23.483967 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.483946    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"]
Jul 02 19:41:23.488136 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.488116    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/auth-test-model-6e39fb-kserve-674ccd7-d7hmf"]
Jul 02 19:41:23.551617 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.551590    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d65916e-7863-48bb-9132-7b8073ef8b79-tls-certs\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.551617 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.551615    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d65916e-7863-48bb-9132-7b8073ef8b79-dshm\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.551795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.551627    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fmss\" (UniqueName: \"kubernetes.io/projected/5d65916e-7863-48bb-9132-7b8073ef8b79-kube-api-access-9fmss\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:41:23.940942 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:23.940911    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d65916e-7863-48bb-9132-7b8073ef8b79" path="/var/lib/kubelet/pods/5d65916e-7863-48bb-9132-7b8073ef8b79/volumes"
Jul 02 19:41:34.872159 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.872126    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"]
Jul 02 19:41:34.872550 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.872466    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d65916e-7863-48bb-9132-7b8073ef8b79" containerName="main"
Jul 02 19:41:34.872550 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.872479    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d65916e-7863-48bb-9132-7b8073ef8b79" containerName="main"
Jul 02 19:41:34.872550 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.872544    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d65916e-7863-48bb-9132-7b8073ef8b79" containerName="main"
Jul 02 19:41:34.876814 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.876791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:34.880365 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.880341    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"kube-root-ca.crt\""
Jul 02 19:41:34.880851 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.880701    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"openshift-service-ca.crt\""
Jul 02 19:41:34.880851 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.880715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"sub-test-model-50666c-kserve-self-signed-certs\""
Jul 02 19:41:34.880851 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.880709    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-50666c\"/\"default-dockercfg-7cjrg\""
Jul 02 19:41:34.882640 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.882619    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"]
Jul 02 19:41:34.956483 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.956445    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-home\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:34.956483 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.956489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-tmp-dir\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:34.956708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.956524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwc6s\" (UniqueName: \"kubernetes.io/projected/63338917-82ac-4f80-8a9f-04c17b50a4cd-kube-api-access-vwc6s\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:34.956708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.956549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63338917-82ac-4f80-8a9f-04c17b50a4cd-tls-certs\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:34.956708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.956647    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-model-cache\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:34.956708 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:34.956665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-dshm\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057522 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-home\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057522 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-tmp-dir\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057763 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwc6s\" (UniqueName: \"kubernetes.io/projected/63338917-82ac-4f80-8a9f-04c17b50a4cd-kube-api-access-vwc6s\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057763 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63338917-82ac-4f80-8a9f-04c17b50a4cd-tls-certs\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057763 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-model-cache\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057763 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057684    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-dshm\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057974 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057947    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-home\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.057974 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.057954    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-tmp-dir\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.058078 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.058060    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-model-cache\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.059885 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.059861    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-dshm\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.060117 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.060100    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63338917-82ac-4f80-8a9f-04c17b50a4cd-tls-certs\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.065563 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.065542    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwc6s\" (UniqueName: \"kubernetes.io/projected/63338917-82ac-4f80-8a9f-04c17b50a4cd-kube-api-access-vwc6s\") pod \"sub-test-model-50666c-kserve-d6cd56667-9lk58\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") " pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.186837 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.186812    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:35.319991 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.319966    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"]
Jul 02 19:41:35.321978 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:41:35.321952    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63338917_82ac_4f80_8a9f_04c17b50a4cd.slice/crio-07f8a34352b7eae18d359baf11451da2b8379c30564aa5b7f830bfdc73d464ea WatchSource:0}: Error finding container 07f8a34352b7eae18d359baf11451da2b8379c30564aa5b7f830bfdc73d464ea: Status 404 returned error can't find the container with id 07f8a34352b7eae18d359baf11451da2b8379c30564aa5b7f830bfdc73d464ea
Jul 02 19:41:35.512307 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.512212    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58" event={"ID":"63338917-82ac-4f80-8a9f-04c17b50a4cd","Type":"ContainerStarted","Data":"96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4"}
Jul 02 19:41:35.512307 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.512260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58" event={"ID":"63338917-82ac-4f80-8a9f-04c17b50a4cd","Type":"ContainerStarted","Data":"07f8a34352b7eae18d359baf11451da2b8379c30564aa5b7f830bfdc73d464ea"}
Jul 02 19:41:35.531370 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:35.531321    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58" podStartSLOduration=1.53130517 podStartE2EDuration="1.53130517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:41:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:41:35.529655106 +0000 UTC m=+2422.147381185" watchObservedRunningTime="2026-07-02 19:41:35.53130517 +0000 UTC m=+2422.149031247"
Jul 02 19:41:45.187199 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:45.187108    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:45.187199 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:45.187180    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:45.200103 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:45.200076    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:41:45.570981 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:41:45.570896    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:42:01.862488 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.862445    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"]
Jul 02 19:42:01.865814 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.865797    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:01.869234 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.869210    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"openshift-service-ca.crt\""
Jul 02 19:42:01.869352 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.869217    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"default-dockercfg-g8872\""
Jul 02 19:42:01.869352 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.869310    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"kube-root-ca.crt\""
Jul 02 19:42:01.869438 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.869320    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"sub-test-model-6e39fb-kserve-self-signed-certs\""
Jul 02 19:42:01.877324 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:01.877301    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"]
Jul 02 19:42:02.004303 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.004263    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-home\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.004303 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.004305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-dshm\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.004525 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.004381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tmp-dir\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.004525 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.004487    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-model-cache\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.004599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.004525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z94g\" (UniqueName: \"kubernetes.io/projected/7a4c6dac-31c0-4465-a5ed-75c2d810a606-kube-api-access-8z94g\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.004599 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.004551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tls-certs\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105056 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.104994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tmp-dir\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105229 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-model-cache\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105229 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z94g\" (UniqueName: \"kubernetes.io/projected/7a4c6dac-31c0-4465-a5ed-75c2d810a606-kube-api-access-8z94g\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105229 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tls-certs\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105229 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-home\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105229 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-dshm\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105799 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105770    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tmp-dir\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105920 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105781    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-model-cache\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.105920 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.105842    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-home\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.107337 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.107318    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-dshm\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.107713 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.107696    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tls-certs\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.113433 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.113381    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z94g\" (UniqueName: \"kubernetes.io/projected/7a4c6dac-31c0-4465-a5ed-75c2d810a606-kube-api-access-8z94g\") pod \"sub-test-model-6e39fb-kserve-7d9dc786d9-46k62\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") " pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.179594 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.179560    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:02.314493 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.314466    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"]
Jul 02 19:42:02.316333 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:42:02.316304    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a4c6dac_31c0_4465_a5ed_75c2d810a606.slice/crio-11f72f13d8f0a6f6aa6c3eeda0979278663ad1deae16d9d294c10fdb54393ee7 WatchSource:0}: Error finding container 11f72f13d8f0a6f6aa6c3eeda0979278663ad1deae16d9d294c10fdb54393ee7: Status 404 returned error can't find the container with id 11f72f13d8f0a6f6aa6c3eeda0979278663ad1deae16d9d294c10fdb54393ee7
Jul 02 19:42:02.637170 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.637132    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62" event={"ID":"7a4c6dac-31c0-4465-a5ed-75c2d810a606","Type":"ContainerStarted","Data":"040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf"}
Jul 02 19:42:02.637349 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.637179    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62" event={"ID":"7a4c6dac-31c0-4465-a5ed-75c2d810a606","Type":"ContainerStarted","Data":"11f72f13d8f0a6f6aa6c3eeda0979278663ad1deae16d9d294c10fdb54393ee7"}
Jul 02 19:42:02.654199 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:02.654150    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62" podStartSLOduration=1.654134894 podStartE2EDuration="1.654134894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:42:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:42:02.652581888 +0000 UTC m=+2449.270307982" watchObservedRunningTime="2026-07-02 19:42:02.654134894 +0000 UTC m=+2449.271860971"
Jul 02 19:42:12.180669 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:12.180630    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:12.181085 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:12.180687    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:12.193682 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:12.193653    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:12.695138 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:12.695106    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:37.336597 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:37.336562    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"]
Jul 02 19:42:38.202135 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:38.202097    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"]
Jul 02 19:42:52.358407 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.358359    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58" podUID="63338917-82ac-4f80-8a9f-04c17b50a4cd" containerName="main" containerID="cri-o://96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4" gracePeriod=45
Jul 02 19:42:52.610082 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.610025    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:42:52.672357 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672325    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwc6s\" (UniqueName: \"kubernetes.io/projected/63338917-82ac-4f80-8a9f-04c17b50a4cd-kube-api-access-vwc6s\") pod \"63338917-82ac-4f80-8a9f-04c17b50a4cd\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") "
Jul 02 19:42:52.672520 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672385    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-dshm\") pod \"63338917-82ac-4f80-8a9f-04c17b50a4cd\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") "
Jul 02 19:42:52.672520 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672429    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-tmp-dir\") pod \"63338917-82ac-4f80-8a9f-04c17b50a4cd\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") "
Jul 02 19:42:52.672520 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672472    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-model-cache\") pod \"63338917-82ac-4f80-8a9f-04c17b50a4cd\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") "
Jul 02 19:42:52.672520 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672508    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-home\") pod \"63338917-82ac-4f80-8a9f-04c17b50a4cd\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") "
Jul 02 19:42:52.672744 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672545    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63338917-82ac-4f80-8a9f-04c17b50a4cd-tls-certs\") pod \"63338917-82ac-4f80-8a9f-04c17b50a4cd\" (UID: \"63338917-82ac-4f80-8a9f-04c17b50a4cd\") "
Jul 02 19:42:52.672744 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672672    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63338917-82ac-4f80-8a9f-04c17b50a4cd" (UID: "63338917-82ac-4f80-8a9f-04c17b50a4cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:52.672849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672795    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-home" (OuterVolumeSpecName: "home") pod "63338917-82ac-4f80-8a9f-04c17b50a4cd" (UID: "63338917-82ac-4f80-8a9f-04c17b50a4cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:52.672849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672817    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-tmp-dir\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:52.672849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.672808    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "63338917-82ac-4f80-8a9f-04c17b50a4cd" (UID: "63338917-82ac-4f80-8a9f-04c17b50a4cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:52.674621 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.674597    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-dshm" (OuterVolumeSpecName: "dshm") pod "63338917-82ac-4f80-8a9f-04c17b50a4cd" (UID: "63338917-82ac-4f80-8a9f-04c17b50a4cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:52.674706 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.674642    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63338917-82ac-4f80-8a9f-04c17b50a4cd-kube-api-access-vwc6s" (OuterVolumeSpecName: "kube-api-access-vwc6s") pod "63338917-82ac-4f80-8a9f-04c17b50a4cd" (UID: "63338917-82ac-4f80-8a9f-04c17b50a4cd"). InnerVolumeSpecName "kube-api-access-vwc6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:42:52.674706 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.674691    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63338917-82ac-4f80-8a9f-04c17b50a4cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63338917-82ac-4f80-8a9f-04c17b50a4cd" (UID: "63338917-82ac-4f80-8a9f-04c17b50a4cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:42:52.773686 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.773660    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-dshm\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:52.773686 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.773682    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-model-cache\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:52.773839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.773692    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63338917-82ac-4f80-8a9f-04c17b50a4cd-home\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:52.773839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.773700    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63338917-82ac-4f80-8a9f-04c17b50a4cd-tls-certs\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:52.773839 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.773708    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwc6s\" (UniqueName: \"kubernetes.io/projected/63338917-82ac-4f80-8a9f-04c17b50a4cd-kube-api-access-vwc6s\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:52.874982 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.874900    2567 generic.go:356] "Generic (PLEG): container finished" podID="63338917-82ac-4f80-8a9f-04c17b50a4cd" containerID="96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4" exitCode=0
Jul 02 19:42:52.874982 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.874964    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"
Jul 02 19:42:52.875206 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.874989    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58" event={"ID":"63338917-82ac-4f80-8a9f-04c17b50a4cd","Type":"ContainerDied","Data":"96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4"}
Jul 02 19:42:52.875206 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.875057    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58" event={"ID":"63338917-82ac-4f80-8a9f-04c17b50a4cd","Type":"ContainerDied","Data":"07f8a34352b7eae18d359baf11451da2b8379c30564aa5b7f830bfdc73d464ea"}
Jul 02 19:42:52.875206 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.875078    2567 scope.go:117] "RemoveContainer" containerID="96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4"
Jul 02 19:42:52.884351 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.884332    2567 scope.go:117] "RemoveContainer" containerID="96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4"
Jul 02 19:42:52.884608 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:42:52.884589    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4\": container with ID starting with 96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4 not found: ID does not exist" containerID="96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4"
Jul 02 19:42:52.884671 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.884614    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4"} err="failed to get container status \"96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4\": rpc error: code = NotFound desc = could not find container \"96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4\": container with ID starting with 96ef69fdad2f3e4777bf461ee28fa43809fcb6eddfc10bfd483b417c21862ee4 not found: ID does not exist"
Jul 02 19:42:52.896402 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.896369    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"]
Jul 02 19:42:52.901743 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:52.901723    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-50666c/sub-test-model-50666c-kserve-d6cd56667-9lk58"]
Jul 02 19:42:53.221948 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.221910    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62" podUID="7a4c6dac-31c0-4465-a5ed-75c2d810a606" containerName="main" containerID="cri-o://040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf" gracePeriod=45
Jul 02 19:42:53.466678 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.466655    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:53.477373 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477325    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-home\") pod \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") "
Jul 02 19:42:53.477479 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477376    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-dshm\") pod \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") "
Jul 02 19:42:53.477479 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477396    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-model-cache\") pod \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") "
Jul 02 19:42:53.477479 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477413    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tmp-dir\") pod \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") "
Jul 02 19:42:53.477479 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z94g\" (UniqueName: \"kubernetes.io/projected/7a4c6dac-31c0-4465-a5ed-75c2d810a606-kube-api-access-8z94g\") pod \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") "
Jul 02 19:42:53.477479 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477446    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tls-certs\") pod \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\" (UID: \"7a4c6dac-31c0-4465-a5ed-75c2d810a606\") "
Jul 02 19:42:53.477779 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477598    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7a4c6dac-31c0-4465-a5ed-75c2d810a606" (UID: "7a4c6dac-31c0-4465-a5ed-75c2d810a606"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:53.477779 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477583    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-home" (OuterVolumeSpecName: "home") pod "7a4c6dac-31c0-4465-a5ed-75c2d810a606" (UID: "7a4c6dac-31c0-4465-a5ed-75c2d810a606"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:53.477779 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477619    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a4c6dac-31c0-4465-a5ed-75c2d810a606" (UID: "7a4c6dac-31c0-4465-a5ed-75c2d810a606"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:53.477888 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477807    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-home\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:53.477888 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477826    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-model-cache\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:53.477888 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.477837    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tmp-dir\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:53.479535 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.479487    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-dshm" (OuterVolumeSpecName: "dshm") pod "7a4c6dac-31c0-4465-a5ed-75c2d810a606" (UID: "7a4c6dac-31c0-4465-a5ed-75c2d810a606"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:53.479535 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.479514    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4c6dac-31c0-4465-a5ed-75c2d810a606-kube-api-access-8z94g" (OuterVolumeSpecName: "kube-api-access-8z94g") pod "7a4c6dac-31c0-4465-a5ed-75c2d810a606" (UID: "7a4c6dac-31c0-4465-a5ed-75c2d810a606"). InnerVolumeSpecName "kube-api-access-8z94g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:42:53.479662 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.479596    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7a4c6dac-31c0-4465-a5ed-75c2d810a606" (UID: "7a4c6dac-31c0-4465-a5ed-75c2d810a606"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:42:53.578451 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.578421    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a4c6dac-31c0-4465-a5ed-75c2d810a606-dshm\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:53.578451 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.578452    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z94g\" (UniqueName: \"kubernetes.io/projected/7a4c6dac-31c0-4465-a5ed-75c2d810a606-kube-api-access-8z94g\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:53.578647 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.578466    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a4c6dac-31c0-4465-a5ed-75c2d810a606-tls-certs\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:42:53.880973 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.880874    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a4c6dac-31c0-4465-a5ed-75c2d810a606" containerID="040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf" exitCode=0
Jul 02 19:42:53.880973 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.880916    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"
Jul 02 19:42:53.880973 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.880961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62" event={"ID":"7a4c6dac-31c0-4465-a5ed-75c2d810a606","Type":"ContainerDied","Data":"040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf"}
Jul 02 19:42:53.881277 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.881000    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62" event={"ID":"7a4c6dac-31c0-4465-a5ed-75c2d810a606","Type":"ContainerDied","Data":"11f72f13d8f0a6f6aa6c3eeda0979278663ad1deae16d9d294c10fdb54393ee7"}
Jul 02 19:42:53.881277 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.881048    2567 scope.go:117] "RemoveContainer" containerID="040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf"
Jul 02 19:42:53.889986 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.889965    2567 scope.go:117] "RemoveContainer" containerID="040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf"
Jul 02 19:42:53.890315 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:42:53.890295    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf\": container with ID starting with 040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf not found: ID does not exist" containerID="040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf"
Jul 02 19:42:53.890373 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.890322    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf"} err="failed to get container status \"040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf\": rpc error: code = NotFound desc = could not find container \"040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf\": container with ID starting with 040325bec6524e33ab169ef33be7d3609132eea12dcdf0463055a34fb56118cf not found: ID does not exist"
Jul 02 19:42:53.901060 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.901035    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"]
Jul 02 19:42:53.904728 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.904708    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/sub-test-model-6e39fb-kserve-7d9dc786d9-46k62"]
Jul 02 19:42:53.941443 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.941415    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63338917-82ac-4f80-8a9f-04c17b50a4cd" path="/var/lib/kubelet/pods/63338917-82ac-4f80-8a9f-04c17b50a4cd/volumes"
Jul 02 19:42:53.941856 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:42:53.941842    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4c6dac-31c0-4465-a5ed-75c2d810a606" path="/var/lib/kubelet/pods/7a4c6dac-31c0-4465-a5ed-75c2d810a606/volumes"
Jul 02 19:43:23.174386 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174348    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"]
Jul 02 19:43:23.174795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174686    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4c6dac-31c0-4465-a5ed-75c2d810a606" containerName="main"
Jul 02 19:43:23.174795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174697    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4c6dac-31c0-4465-a5ed-75c2d810a606" containerName="main"
Jul 02 19:43:23.174795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174719    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63338917-82ac-4f80-8a9f-04c17b50a4cd" containerName="main"
Jul 02 19:43:23.174795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174729    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63338917-82ac-4f80-8a9f-04c17b50a4cd" containerName="main"
Jul 02 19:43:23.174795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174794    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="63338917-82ac-4f80-8a9f-04c17b50a4cd" containerName="main"
Jul 02 19:43:23.174958 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.174802    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4c6dac-31c0-4465-a5ed-75c2d810a606" containerName="main"
Jul 02 19:43:23.177704 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.177678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.184362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.181661    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"default-dockercfg-g8872\""
Jul 02 19:43:23.184362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.182322    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"rate-test-model-6e39fb-kserve-self-signed-certs\""
Jul 02 19:43:23.184362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.182669    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"openshift-service-ca.crt\""
Jul 02 19:43:23.184362 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.181249    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6e39fb\"/\"kube-root-ca.crt\""
Jul 02 19:43:23.188618 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.188593    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"]
Jul 02 19:43:23.246595 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.246553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-model-cache\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.246595 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.246600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee528030-8761-4a70-998f-ce829496830f-tls-certs\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.246830 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.246640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-tmp-dir\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.246830 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.246687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-dshm\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.246830 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.246754    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrl98\" (UniqueName: \"kubernetes.io/projected/ee528030-8761-4a70-998f-ce829496830f-kube-api-access-vrl98\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.246830 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.246802    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-home\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347474 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-dshm\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347474 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrl98\" (UniqueName: \"kubernetes.io/projected/ee528030-8761-4a70-998f-ce829496830f-kube-api-access-vrl98\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347719 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-home\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347719 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-model-cache\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347719 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347573    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee528030-8761-4a70-998f-ce829496830f-tls-certs\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347719 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-tmp-dir\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347912    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-home\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.347996 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347966    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-model-cache\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.348087 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.347992    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-tmp-dir\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.349861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.349837    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-dshm\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.350085 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.350068    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee528030-8761-4a70-998f-ce829496830f-tls-certs\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.356001 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.355976    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrl98\" (UniqueName: \"kubernetes.io/projected/ee528030-8761-4a70-998f-ce829496830f-kube-api-access-vrl98\") pod \"rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") " pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.499649 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.499559    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:23.634859 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:23.634831    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"]
Jul 02 19:43:23.636375 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:43:23.636339    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee528030_8761_4a70_998f_ce829496830f.slice/crio-29dbc7097359c9a29699b83f5a23f0d1822e22772875c20f1464e3ca6697bb6a WatchSource:0}: Error finding container 29dbc7097359c9a29699b83f5a23f0d1822e22772875c20f1464e3ca6697bb6a: Status 404 returned error can't find the container with id 29dbc7097359c9a29699b83f5a23f0d1822e22772875c20f1464e3ca6697bb6a
Jul 02 19:43:24.013992 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:24.013957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp" event={"ID":"ee528030-8761-4a70-998f-ce829496830f","Type":"ContainerStarted","Data":"83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0"}
Jul 02 19:43:24.013992 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:24.013996    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp" event={"ID":"ee528030-8761-4a70-998f-ce829496830f","Type":"ContainerStarted","Data":"29dbc7097359c9a29699b83f5a23f0d1822e22772875c20f1464e3ca6697bb6a"}
Jul 02 19:43:24.029982 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:24.029936    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp" podStartSLOduration=1.02992005 podStartE2EDuration="1.02992005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:43:24.028745909 +0000 UTC m=+2530.646471988" watchObservedRunningTime="2026-07-02 19:43:24.02992005 +0000 UTC m=+2530.647646128"
Jul 02 19:43:33.500435 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:33.500398    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:33.500435 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:33.500441    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:33.512747 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:33.512719    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:43:34.074761 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:43:34.074728    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:44:08.655721 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:08.655685    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"]
Jul 02 19:44:23.675647 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:23.675584    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp" podUID="ee528030-8761-4a70-998f-ce829496830f" containerName="main" containerID="cri-o://83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0" gracePeriod=45
Jul 02 19:44:23.919190 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:23.919165    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:44:24.004205 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004125    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrl98\" (UniqueName: \"kubernetes.io/projected/ee528030-8761-4a70-998f-ce829496830f-kube-api-access-vrl98\") pod \"ee528030-8761-4a70-998f-ce829496830f\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") "
Jul 02 19:44:24.004205 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004183    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-home\") pod \"ee528030-8761-4a70-998f-ce829496830f\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") "
Jul 02 19:44:24.004414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004241    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee528030-8761-4a70-998f-ce829496830f-tls-certs\") pod \"ee528030-8761-4a70-998f-ce829496830f\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") "
Jul 02 19:44:24.004414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-dshm\") pod \"ee528030-8761-4a70-998f-ce829496830f\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") "
Jul 02 19:44:24.004414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004315    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-model-cache\") pod \"ee528030-8761-4a70-998f-ce829496830f\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") "
Jul 02 19:44:24.004414 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004340    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-tmp-dir\") pod \"ee528030-8761-4a70-998f-ce829496830f\" (UID: \"ee528030-8761-4a70-998f-ce829496830f\") "
Jul 02 19:44:24.004639 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004484    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-home" (OuterVolumeSpecName: "home") pod "ee528030-8761-4a70-998f-ce829496830f" (UID: "ee528030-8761-4a70-998f-ce829496830f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:24.004693 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004622    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee528030-8761-4a70-998f-ce829496830f" (UID: "ee528030-8761-4a70-998f-ce829496830f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:24.004693 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004638    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee528030-8761-4a70-998f-ce829496830f" (UID: "ee528030-8761-4a70-998f-ce829496830f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:24.004772 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004742    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-model-cache\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.004807 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004781    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-tmp-dir\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.004807 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.004795    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-home\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.006284 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.006259    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-dshm" (OuterVolumeSpecName: "dshm") pod "ee528030-8761-4a70-998f-ce829496830f" (UID: "ee528030-8761-4a70-998f-ce829496830f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:44:24.006389 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.006358    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee528030-8761-4a70-998f-ce829496830f-kube-api-access-vrl98" (OuterVolumeSpecName: "kube-api-access-vrl98") pod "ee528030-8761-4a70-998f-ce829496830f" (UID: "ee528030-8761-4a70-998f-ce829496830f"). InnerVolumeSpecName "kube-api-access-vrl98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:44:24.006445 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.006391    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee528030-8761-4a70-998f-ce829496830f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee528030-8761-4a70-998f-ce829496830f" (UID: "ee528030-8761-4a70-998f-ce829496830f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:44:24.106113 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.106075    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee528030-8761-4a70-998f-ce829496830f-dshm\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.106113 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.106109    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrl98\" (UniqueName: \"kubernetes.io/projected/ee528030-8761-4a70-998f-ce829496830f-kube-api-access-vrl98\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.106113 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.106119    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee528030-8761-4a70-998f-ce829496830f-tls-certs\") on node \"ip-10-0-141-37.ec2.internal\" DevicePath \"\""
Jul 02 19:44:24.301972 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.301884    2567 generic.go:356] "Generic (PLEG): container finished" podID="ee528030-8761-4a70-998f-ce829496830f" containerID="83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0" exitCode=0
Jul 02 19:44:24.301972 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.301931    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"
Jul 02 19:44:24.302174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.301973    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp" event={"ID":"ee528030-8761-4a70-998f-ce829496830f","Type":"ContainerDied","Data":"83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0"}
Jul 02 19:44:24.302174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.302045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp" event={"ID":"ee528030-8761-4a70-998f-ce829496830f","Type":"ContainerDied","Data":"29dbc7097359c9a29699b83f5a23f0d1822e22772875c20f1464e3ca6697bb6a"}
Jul 02 19:44:24.302174 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.302067    2567 scope.go:117] "RemoveContainer" containerID="83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0"
Jul 02 19:44:24.311544 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.311527    2567 scope.go:117] "RemoveContainer" containerID="83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0"
Jul 02 19:44:24.311785 ip-10-0-141-37 kubenswrapper[2567]: E0702 19:44:24.311768    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0\": container with ID starting with 83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0 not found: ID does not exist" containerID="83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0"
Jul 02 19:44:24.311833 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.311794    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0"} err="failed to get container status \"83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0\": rpc error: code = NotFound desc = could not find container \"83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0\": container with ID starting with 83b4c632de64d85243797728fdd4969efbbf2ab450fd63c6cfb2263738e375a0 not found: ID does not exist"
Jul 02 19:44:24.323742 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.323722    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"]
Jul 02 19:44:24.330311 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:24.330278    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6e39fb/rate-test-model-6e39fb-kserve-7c4c4d8555-hltzp"]
Jul 02 19:44:25.940104 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:44:25.940073    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee528030-8761-4a70-998f-ce829496830f" path="/var/lib/kubelet/pods/ee528030-8761-4a70-998f-ce829496830f/volumes"
Jul 02 19:45:00.418632 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:00.418554    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5ccbc6f4-drmxc_59345305-393c-4c0e-9769-aa866e7cd948/authorino/0.log"
Jul 02 19:45:06.190442 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:06.190414    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-df9gs_614b9b98-7011-4ca5-b7ea-7d0102ae3a1d/manager/0.log"
Jul 02 19:45:06.542924 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:06.542841    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-psvtf_6b4d879c-6bef-44f4-afd4-d4a18a3e96fc/copy-manifests/0.log"
Jul 02 19:45:06.555977 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:06.555945    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-psvtf_6b4d879c-6bef-44f4-afd4-d4a18a3e96fc/manager/0.log"
Jul 02 19:45:08.009188 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:08.009156    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5ccbc6f4-drmxc_59345305-393c-4c0e-9769-aa866e7cd948/authorino/0.log"
Jul 02 19:45:08.626199 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:08.626172    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4jf9b_9c4fad7b-4244-49a8-b458-11ffbed637f3/manager/0.log"
Jul 02 19:45:09.621518 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:09.621489    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-tsw88_acd000c7-3bf1-4b8c-b091-17d499a0f857/kube-auth-proxy/0.log"
Jul 02 19:45:10.668605 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:10.668573    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rlsnf_5319a1b8-89ca-4450-bb1b-8813cee83ab8/main/0.log"
Jul 02 19:45:10.920034 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:10.919930    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8x27h_44c09208-c0d2-4a33-b280-9da6f934623f/main/0.log"
Jul 02 19:45:11.029540 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:11.029513    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-jrxjd_ccc40b07-6c87-4764-8a57-3b9476af8331/main/0.log"
Jul 02 19:45:14.974504 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.974468    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srs74/must-gather-nwvz5"]
Jul 02 19:45:14.974884 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.974815    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee528030-8761-4a70-998f-ce829496830f" containerName="main"
Jul 02 19:45:14.974884 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.974827    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee528030-8761-4a70-998f-ce829496830f" containerName="main"
Jul 02 19:45:14.974884 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.974879    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee528030-8761-4a70-998f-ce829496830f" containerName="main"
Jul 02 19:45:14.978960 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.978938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:14.981725 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.981702    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-srs74\"/\"default-dockercfg-5b97m\""
Jul 02 19:45:14.982580 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.982560    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srs74\"/\"kube-root-ca.crt\""
Jul 02 19:45:14.982648 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.982568    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srs74\"/\"openshift-service-ca.crt\""
Jul 02 19:45:14.988845 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:14.988824    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/must-gather-nwvz5"]
Jul 02 19:45:15.043212 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.043184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf2hn\" (UniqueName: \"kubernetes.io/projected/126159d3-2bb8-450e-8773-8577bc78d797-kube-api-access-wf2hn\") pod \"must-gather-nwvz5\" (UID: \"126159d3-2bb8-450e-8773-8577bc78d797\") " pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.043359 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.043240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/126159d3-2bb8-450e-8773-8577bc78d797-must-gather-output\") pod \"must-gather-nwvz5\" (UID: \"126159d3-2bb8-450e-8773-8577bc78d797\") " pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.144449 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.144415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf2hn\" (UniqueName: \"kubernetes.io/projected/126159d3-2bb8-450e-8773-8577bc78d797-kube-api-access-wf2hn\") pod \"must-gather-nwvz5\" (UID: \"126159d3-2bb8-450e-8773-8577bc78d797\") " pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.144626 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.144496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/126159d3-2bb8-450e-8773-8577bc78d797-must-gather-output\") pod \"must-gather-nwvz5\" (UID: \"126159d3-2bb8-450e-8773-8577bc78d797\") " pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.144838 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.144817    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/126159d3-2bb8-450e-8773-8577bc78d797-must-gather-output\") pod \"must-gather-nwvz5\" (UID: \"126159d3-2bb8-450e-8773-8577bc78d797\") " pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.153786 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.153758    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf2hn\" (UniqueName: \"kubernetes.io/projected/126159d3-2bb8-450e-8773-8577bc78d797-kube-api-access-wf2hn\") pod \"must-gather-nwvz5\" (UID: \"126159d3-2bb8-450e-8773-8577bc78d797\") " pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.289562 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.289478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/must-gather-nwvz5"
Jul 02 19:45:15.422134 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.422107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/must-gather-nwvz5"]
Jul 02 19:45:15.424185 ip-10-0-141-37 kubenswrapper[2567]: W0702 19:45:15.424158    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod126159d3_2bb8_450e_8773_8577bc78d797.slice/crio-e87e76a7466486f903d2181482fb780867a2b893dd2d383e103f952149331b08 WatchSource:0}: Error finding container e87e76a7466486f903d2181482fb780867a2b893dd2d383e103f952149331b08: Status 404 returned error can't find the container with id e87e76a7466486f903d2181482fb780867a2b893dd2d383e103f952149331b08
Jul 02 19:45:15.426197 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.426179    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:45:15.532340 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:15.532304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/must-gather-nwvz5" event={"ID":"126159d3-2bb8-450e-8773-8577bc78d797","Type":"ContainerStarted","Data":"e87e76a7466486f903d2181482fb780867a2b893dd2d383e103f952149331b08"}
Jul 02 19:45:16.542029 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:16.541477    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/must-gather-nwvz5" event={"ID":"126159d3-2bb8-450e-8773-8577bc78d797","Type":"ContainerStarted","Data":"add0d4aed8008e03e13781bdbefa6815800e5d4c811f5847d151b28bfed5f85c"}
Jul 02 19:45:16.542029 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:16.541534    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/must-gather-nwvz5" event={"ID":"126159d3-2bb8-450e-8773-8577bc78d797","Type":"ContainerStarted","Data":"63f4d7dd3c0f85528872be41d944b727b553a27e4b2374b1cf54bdfb841b8da7"}
Jul 02 19:45:17.783427 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:17.783398    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ntq7g_cb7b2256-9d00-45a5-9beb-203f649a7b03/global-pull-secret-syncer/0.log"
Jul 02 19:45:17.950027 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:17.949980    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x6l4g_4a773485-54c9-40aa-8c58-e36909f69126/konnectivity-agent/0.log"
Jul 02 19:45:18.057671 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:18.057592    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-37.ec2.internal_cb15ed011179ac858abbc3d152c7f014/haproxy/0.log"
Jul 02 19:45:22.894185 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:22.894088    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5ccbc6f4-drmxc_59345305-393c-4c0e-9769-aa866e7cd948/authorino/0.log"
Jul 02 19:45:23.314830 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:23.314367    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4jf9b_9c4fad7b-4244-49a8-b458-11ffbed637f3/manager/0.log"
Jul 02 19:45:25.143142 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.143093    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/alertmanager/0.log"
Jul 02 19:45:25.167146 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.167114    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/config-reloader/0.log"
Jul 02 19:45:25.200195 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.200170    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/kube-rbac-proxy-web/0.log"
Jul 02 19:45:25.227875 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.227794    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/kube-rbac-proxy/0.log"
Jul 02 19:45:25.254429 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.254396    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/kube-rbac-proxy-metric/0.log"
Jul 02 19:45:25.277765 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.277738    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/prom-label-proxy/0.log"
Jul 02 19:45:25.304112 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.304078    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2ca503f0-36ae-49c2-ae91-b524a733c4a5/init-config-reloader/0.log"
Jul 02 19:45:25.376570 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.376540    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lvps2_59bccca5-d733-4403-b6aa-e2ef19eef9d0/kube-state-metrics/0.log"
Jul 02 19:45:25.406732 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.406658    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lvps2_59bccca5-d733-4403-b6aa-e2ef19eef9d0/kube-rbac-proxy-main/0.log"
Jul 02 19:45:25.439491 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.439450    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lvps2_59bccca5-d733-4403-b6aa-e2ef19eef9d0/kube-rbac-proxy-self/0.log"
Jul 02 19:45:25.468977 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.468944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b9bf99685-wc9q2_602d6f6d-c409-42cb-921c-82460c5bb84b/metrics-server/0.log"
Jul 02 19:45:25.533240 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.533209    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cgr5_452418c6-4d59-4f62-8491-54bb5137a62a/node-exporter/0.log"
Jul 02 19:45:25.555503 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.555476    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cgr5_452418c6-4d59-4f62-8491-54bb5137a62a/kube-rbac-proxy/0.log"
Jul 02 19:45:25.581746 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:25.581701    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6cgr5_452418c6-4d59-4f62-8491-54bb5137a62a/init-textfile/0.log"
Jul 02 19:45:26.295885 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:26.295854    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f6ff4d96-92596_254d07eb-e443-4aef-8a42-f6cea4d8ddf4/telemeter-client/0.log"
Jul 02 19:45:26.317032 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:26.316996    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f6ff4d96-92596_254d07eb-e443-4aef-8a42-f6cea4d8ddf4/reload/0.log"
Jul 02 19:45:26.341268 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:26.341220    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f6ff4d96-92596_254d07eb-e443-4aef-8a42-f6cea4d8ddf4/kube-rbac-proxy/0.log"
Jul 02 19:45:27.857934 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.857868    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srs74/must-gather-nwvz5" podStartSLOduration=13.080915 podStartE2EDuration="13.857833015s" totalImagesPullingTime="776.918015ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:16.559460662 +0000 UTC m=+2643.177186740" watchObservedRunningTime="2026-07-02 19:45:27.857833015 +0000 UTC m=+2654.475559096"
Jul 02 19:45:27.858917 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.858889    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"]
Jul 02 19:45:27.864106 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.864081    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:27.871495 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.871431    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"]
Jul 02 19:45:27.987607 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.987557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-lib-modules\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:27.987819 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.987696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvpc\" (UniqueName: \"kubernetes.io/projected/c1da585e-152c-46cb-9d3c-aa6adcd2847a-kube-api-access-gdvpc\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:27.987819 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.987730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-podres\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:27.987819 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.987774    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-proc\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:27.987819 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:27.987812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-sys\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089319 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvpc\" (UniqueName: \"kubernetes.io/projected/c1da585e-152c-46cb-9d3c-aa6adcd2847a-kube-api-access-gdvpc\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089517 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-podres\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089517 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-proc\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089517 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089436    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-sys\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089517 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-lib-modules\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089759 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089730    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-proc\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.089930 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089743    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-lib-modules\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.090056 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089802    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-sys\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.090161 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.089867    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1da585e-152c-46cb-9d3c-aa6adcd2847a-podres\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.097959 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.097936    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvpc\" (UniqueName: \"kubernetes.io/projected/c1da585e-152c-46cb-9d3c-aa6adcd2847a-kube-api-access-gdvpc\") pod \"perf-node-gather-daemonset-lfmnr\" (UID: \"c1da585e-152c-46cb-9d3c-aa6adcd2847a\") " pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.186642 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.186595    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.295273 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.295238    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/1.log"
Jul 02 19:45:28.301657 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.301609    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-qnvkr_c5d7edc4-4bec-43f5-9737-85bfcfd33fb3/console-operator/2.log"
Jul 02 19:45:28.369928 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.369361    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"]
Jul 02 19:45:28.646849 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.646816    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr" event={"ID":"c1da585e-152c-46cb-9d3c-aa6adcd2847a","Type":"ContainerStarted","Data":"cb7e0258bfeeec5afd91c9c3fbdf3ce723d098435641c65fbac2fd207b5dd586"}
Jul 02 19:45:28.647047 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.646874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr" event={"ID":"c1da585e-152c-46cb-9d3c-aa6adcd2847a","Type":"ContainerStarted","Data":"4db6a47f146f57d91a8ebee7163be8fc82d5cb764966fdba1f68879a5a7d61d5"}
Jul 02 19:45:28.647137 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.647062    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:28.663610 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:28.663557    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr" podStartSLOduration=1.663539749 podStartE2EDuration="1.663539749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:28.663154541 +0000 UTC m=+2655.280880631" watchObservedRunningTime="2026-07-02 19:45:28.663539749 +0000 UTC m=+2655.281265827"
Jul 02 19:45:30.492908 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:30.492878    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r884g_37ebe3ab-fdd1-46b7-aa44-be602d2cdb93/dns/0.log"
Jul 02 19:45:30.512285 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:30.512248    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r884g_37ebe3ab-fdd1-46b7-aa44-be602d2cdb93/kube-rbac-proxy/0.log"
Jul 02 19:45:30.533542 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:30.533519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dhjtj_a9fbd075-b1d2-4ed7-a5bf-05771c992f32/dns-node-resolver/0.log"
Jul 02 19:45:31.109490 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:31.109465    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c6bc5d5f9-hllff_1bd6199b-7d84-4826-94b7-c59a022e7ac4/registry/0.log"
Jul 02 19:45:31.184774 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:31.184746    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqdfw_1ab89a9b-52b3-46e9-a219-9a23779478dc/node-ca/0.log"
Jul 02 19:45:32.292795 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:32.292765    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-tsw88_acd000c7-3bf1-4b8c-b091-17d499a0f857/kube-auth-proxy/0.log"
Jul 02 19:45:33.128563 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:33.128534    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lzs4_435b3531-7335-491b-bc65-8a959f46ac74/serve-healthcheck-canary/0.log"
Jul 02 19:45:33.651981 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:33.651944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-b7n4s_e5716715-9858-4e3e-9b4f-51cd49ff3cae/insights-operator/0.log"
Jul 02 19:45:33.652416 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:33.652202    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-b7n4s_e5716715-9858-4e3e-9b4f-51cd49ff3cae/insights-operator/1.log"
Jul 02 19:45:33.827775 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:33.827749    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4kwg_75aefc8a-1179-4c2e-a5ac-869d440f366b/kube-rbac-proxy/0.log"
Jul 02 19:45:33.849704 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:33.849675    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4kwg_75aefc8a-1179-4c2e-a5ac-869d440f366b/exporter/0.log"
Jul 02 19:45:33.875786 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:33.875761    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4kwg_75aefc8a-1179-4c2e-a5ac-869d440f366b/extractor/0.log"
Jul 02 19:45:34.663834 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:34.663807    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-srs74/perf-node-gather-daemonset-lfmnr"
Jul 02 19:45:36.712464 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:36.712430    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-df9gs_614b9b98-7011-4ca5-b7ea-7d0102ae3a1d/manager/0.log"
Jul 02 19:45:36.919516 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:36.919462    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-psvtf_6b4d879c-6bef-44f4-afd4-d4a18a3e96fc/manager/0.log"
Jul 02 19:45:36.936861 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:36.936836    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d984f5d94-psvtf_6b4d879c-6bef-44f4-afd4-d4a18a3e96fc/copy-manifests/0.log"
Jul 02 19:45:38.307838 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:38.307806    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7965745c7f-4r5rd_abd9e2f0-d72d-41e3-8bb5-9b89d2680b10/manager/0.log"
Jul 02 19:45:38.463637 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:38.463603    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-tsw88_acd000c7-3bf1-4b8c-b091-17d499a0f857/kube-auth-proxy/0.log"
Jul 02 19:45:39.807623 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:39.807551    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-595b598896-tsw88_acd000c7-3bf1-4b8c-b091-17d499a0f857/kube-auth-proxy/0.log"
Jul 02 19:45:43.563106 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:43.563066    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jrzx5_d682916b-5585-4223-b006-81ea2e6a4fd0/kube-storage-version-migrator-operator/1.log"
Jul 02 19:45:43.564003 ip-10-0-141-37 kubenswrapper[2567]: I0702 19:45:43.563983    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-jrzx5_d682916b-5585-4223-b006-81ea2e6a4fd0/kube-storage-version-migrator-operator/0.log"